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Abstract 


In this technical report, we present the results of a reliability study of the fifth-grade 
multiple choice reading comprehension measures available on the easyCBM learning 
system conducted in the spring of 20 1 1 . Analyses include split-half reliability, alternate 
form reliability, person and item reliability as derived from Rasch analysis, top / bottom 
reliability, and repeated measures analysis of variance (ANOVA). Results suggest 
adequate reliability for the fifth grade multiple choice reading comprehension measures. 



Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 5 

Curriculum-based measures (CBMs) are standardized assessments with a rich history of 
use for screening students at risk for difficulty in reading as well as for tracking the progress 
students make in gaining essential skills over the course of a school year (Alonzo, Ketterlin- 
Geller, & Tindal, 2006). In recent years, the widespread adoption of Response to Intervention 
(RTI) as a model for instructional delivery and school-wide improvement efforts has resulted in 
renewed attention being given to CBMs and a greater emphasis being placed on their technical 
adequacy for a variety of uses. One concern expressed by practitioners and researchers alike is 
the degree to which the brief, individually-administered fluency-based probes most frequently 
identified with CBM are appropriate for use with older students. As students move from 
elementary to secondary school, there is some evidence to suggest that more complex CBMs, 
designed to measure more challenging constructs, such as reading comprehension and 
vocabulary in context may be more appropriate (Yovanoff, Duesbery, Alonzo, & Tindal, 2005). 
In this technical report, we describe a study of the reliability of the easyCBM second-grade 
multiple choice reading comprehension measures conducted in 201 1. 

Methods 

In this section, we describe the methods used in conducting a study of the split-half and 
top-bottom reliability, as well as Rasch analyses of grade 5 multiple-choice reading 
comprehension (MCRC) measures from the easyCBM 1 * assessment system. 

Setting and Participants 

The study was conducted in elementary and middle schools from two Pacific Northwest 
public school districts in the spring of 201 1. District A was diverse, and comprised of 
approximately 8,900 students, of which approximately 56% were White, 1 1% Hispanic, 15% 



Asian-Pacific Islander, 11% Multiracial, 7% Black, and 1% American Indian- Alaskan Native 
students. About 26% of students were eligible for free or reduced-priced meals. Students in 
District A outperformed their peers in the state on the statewide reading assessment. On average, 
more than 79% of students in grades 3-8 tested proficient on the statewide reading test, compared 
to about 67% for the state. In all, 27 teachers (six in grade 2, four in grade 3, five in grade 4, six 
in grade 5, and six in grade 6) and 715 students participated in the study from District A. 

District B was a large and diverse school district, of approximately 14,000 students, with 
a demographic make-up of approximately 56% White, 15% Hispanic, 11% Asian-Pacific 
Islander, 11% Multiracial, 6% Black, and 2% American Indian-Alaskan Native students. About 
34% of students in the district were eligible for free or reduced-priced meals. In 2010, students 
from District B slightly outperformed their peers in the state on the statewide reading 
assessment. On average, a little fewer than 69% of students in grades 3-8 tested proficient on the 
state reading test, compared to about 67% for the state. Fourth grade showed the largest 
difference between students scoring proficient for the district and state, 72% compared to 67%, 
respectively. Six teachers (two in grades 3 and 7, one in grades 4 and 8) and 317 students 
participated in the study from District B. 

Because we wanted to investigate the reliability for the full grade range of easyCBM R 
MCRC tests, we recruited participants from grades 2-8, with a goal of recruiting six teachers, 
with a corresponding six classes of students, from each of these seven grades. We successfully 
recruited six teachers for grades 2-6. Two teachers were recruited for grade 7 (seven total 
classes of students), and one for grade 8 (three total classes). The average class size across all 
grades was 27 students. Teachers were recruited at the district level and were compensated $150 
for participating in the study. The three participating teachers in grades 7 and 8 were given 



additional stipend money because they administered comprehension measures to more than one 
class of students. All students in attendance on the days the MCRC tests were administered 
participated in the study. 

Multiple-choice Reading Comprehension Measures 

The reading comprehension measures on easy CBM® are designed for group 
administration and are available for grades 2-8. Students first read an original work of narrative 
fiction and then answer multiple-choice questions (12 questions on the grade 2 test, 20 questions 
on each of the grade 3-8 tests) based on the story. Multiple-choice questions are designed to 
assess literal and inferential comprehension on all grade level tests; evaluative comprehension is 
also assessed on the grade 3-8 tests. Each question is comprised of the question stem and three 
possible answer choices: the correct answer and two incorrect but plausible distractors. The 
comprehension measures have a total of 12 points (grade 2) or 20 points (grades 3-8) possible; 
students earn one point for every question they answer correctly. 

We selected the format of the reading comprehension tests based on prior empirical work 
with local school districts (Alonzo & Tindal, 2004a, 2004b, 2004c). In this work, teachers had 
expressed their desire for tests that closely resembled the types of readings students regularly 
encountered in their classes. At the same time, concerns about increasing the reliability, ease of 
use, and cost-effectiveness of our measures prompted us to use selected response rather than 
open-ended question types in our comprehension measures. Accordingly, we developed the 
MCRC tests in a two-step process. First, we wrote the stories that were used as the basis for 
each test. Then, we wrote the test items associated with each story. We embedded quality 
control and content review processes in both these steps throughout instrument development. 

Two people, selected for their expertise in instrument development and language arts, 



were principally involved with overseeing the creation of the MCRC tests. The first person 
oversaw the creation and revision of the stories and test items earned her Bachelor of Arts degree 
in Literature from Carleton College in 1990, worked for twelve years as an English teacher in 
California public schools, was awarded National Board for Professional Teaching Standards 
certification in Adolescent and Young Adulthood English Language Arts in 2002, and earned her 
Ph.D. in the area of Learning Assessments/System Performance at the University of Oregon. 

The second person hired to write the MCRC items earned his Ph.D. in education psychology, 
measurement, and methodology from the University of Arizona. He has worked in education at 
the elementary and middle school levels, as well as in higher education and at the state level. He 
held a position as associate professor in the distance-learning program for Northern Arizona 
University and served as director of assessment for a large metropolitan school district in 
Phoenix, Arizona. In addition, he served as state Director of Assessment and Deputy Associate 
Superintendent for Standards and Assessment at the Arizona Department of Education. He was 
a test development manager for Harcourt Assessment and has broad experience in assessment 
and test development. 

Grade 5 test development. The two individuals hired to develop the grade 5 measures 
worked together to create documentation for story-writers to use while creating their stories. 

This written documentation was provided to increase the comparability of story structure and 
reduce the likelihood of construct irrelevant variance related to variation in story type affecting 
student performance on the different forms of the comprehension measures. Story creation 
specifications provided infonnation about the length of the stories (approximately 1,500 words), 
characters, settings, and plots. Stories, which were composed between June 2006 and January 
2007, were written by a variety of people who were either elementary and secondary school 



teachers or graduate students in the College of Education. In all, 24 stories were written; 4 did 
not pass the criteria required for use in the assessment system, leaving 20 to be piloted at the fifth 
grade level. 

The professional item writer we hired created 20 multiple-choice questions, each with 
three possible answer options, for each form of the grade 5 MCRC test. In all, he wrote 400 
multiple-choice questions. All fifth-grade questions were written between July and October of 
2007. For each of the fifth-grade MCRC tests, we wrote seven questions targeting literal 
comprehension, seven questions targeting inferential comprehension, and six questions targeting 
evaluative comprehension, for a total of 20 items on each form of the test. Within each type of 
comprehension, item-writing specifications called for a range of difficulty such that each form of 
each test contained some easy, moderate, and difficult items in each of the types of 
comprehension assessed on that test. Item-writing specifications also guided the ordering of the 
items on each fonn of the MCRC test. In all cases, we followed a similar pattern of item 
ordering, beginning with the easiest literal comprehension item and continuing with items of 
increasing difficulty, ending with an item designed to be one of the most challenging, pulled 
from the highest level of comprehension assessed in that grade level (evaluative comprehension 
in grade 5). Once the multiple-choice items were written, the stories and item lists were 
formatted into individual tests, each comprised of a story and 20 multiple-choice test items. 
Alonzo and Tindal (2008) provided a detailed description of the development and technical 
adequacy of the grade 5 MCRC test. 

Grade 5 test selection and administration. We selected a subset of MCRC grade 5 
forms (roughly 60% of those available through the casyCBM ' assessment system) to use in this 
study. We used forms 8, 9, 10, 11, 12, 13, 14, 15, and 16 in this study. We selected these grade 



5 forms because higher form numbers are typically used less in the classroom compared to the 
lower-numbered assessment forms (e.g., forms 1-7) on which we have already completed earlier 
research; thus, we deemed further understanding fonn and item-level reliability statistics of the 
selected fonns a priority. 

Each student participated in the testing on three separate testing occasions in three 
different sessions, roughly one week apart. Each comprehension measure was group 
administered by the classroom teacher. In the first session, students completed a comprehension 
form assigned by class. Roughly one week later, students completed an alternate form of the 
comprehension measure. On the final testing occasion, students completed a third alternate 
form. To reduce the possibility of the order of the forms completed adversely affecting testing 
results, we assigned comprehension forms within a given grade at the class level based on a two- 
group counterbalanced measure design. For instance, the first of the six participating grade 2 
classes completed forms 11, 12, and 13, in that order, over the three testing occasions; the second 
grade 2 class completed fonns 13,12 and 1 1 (the opposite order of the first). We used the same 
counterbalanced measure design for all classes and all grades in the study. 

Analysis 

We used a variety of approaches to study the reliability of the easyCBM comprehension 
assessments: repeated measures analysis of variance, split half reliability using the Guttman 
formula, top/bottom reliability, and Rasch analysis. Each of these analytic approaches is 
explained in more detail in the following section. 

One-way repeated measures analysis of variance. To examine whether there was a 
significant difference in difficulty across the forms, we conducted one-way repeated measures 
analysis of variance (ANOVA). Each student completed three test fonns in each grade. When 



there was a statistically significant within- subject effect, the mean differences among the three 
forms were further analyzed to investigate where the significant within-subject difference 
resided. 

Split-half reliability. We conducted form and item-level reliability analyses for all 
grades in this study. To assess overall reliability of the MCRC measure, we examined the 
internal consistency among items within each selected test form using split-half reliability 
coefficients calculated from the Guttman formula using SPSS 19 (SPSS Inc., 2010). We used 
the Guttman formula to calculate split-half reliability coefficients because the Guttman formula 
does not assume homogeneity of test halves and will not overestimate the full-form reliability 
(Kerlinger & Lee, 2000). Thus, we felt the Guttman formula provided a more conservative and 
reasonable estimate of full test form reliability. 

Top-bottom reliability. We computed the total score based on the scored item-level 
data, with unanswered items scored as incorrect (i.e., “0”). The possible total score for grade 5 
forms is 20. Because casyCBM ' progress monitoring measures were developed to target 
students who are at-risk for academic failure, items should function differently for students who 
are at or below the 23rd percentile (i.e., lower percentiles) and those who are at or above the 78th 
percentile (i.e., higher percentiles). To evaluate the appropriateness of items, item functioning 
was compared between the two aforementioned groups. The scores corresponding to the 23rd 
and 78th percentiles were computed for each fonn. Then, the proportions of correct responses 
for each item for the two groups were analyzed. Both groups should demonstrate high 
proportions of correct responses for an easy item that functions appropriately. For a difficult 
item that is functioning appropriately, the proportion of correct responses for the lower percentile 
group should be lower than that for the higher percentile group. A higher proportion of correct 



responses for the lower percentile group indicates that the item may not be functioning 
appropriately. 

Rasch analyses. Data from the pilot testing of the MCRC measures were analyzed with 
a one-parameter logistic Rasch analysis using the software Winsteps 3.68.2 (Linacre, 2009). 
Unlike classical statistics, Rasch analyses consider patterns of responses across individuals, 
providing information at a level of specificity in results unattainable with approaches based on 
classical statistics used in the development of most CBMs. In a complex iterative process, a 
Rasch analysis concurrently estimates the difficulty of individual test items and the ability level 
of each individual test taker. The results, relevant to the discussion here, include an estimation 
of the difficulty (referred to as the ‘measure’) of each item, the standard error of measure 
associated with each item’s estimated difficulty, and the degree to which each item ‘fits’ the 
measurement model (referred to as the ‘mean square outfit’). In addition, a Rasch analysis can 
provide information about the average estimated ability of students who selected each of the 
possible answer choices. All of this information must be considered when evaluating the 
technical adequacy of the measures, as described below. 

Considering item estimated difficulty. Rasch analyses, which examine each item’s 
reliability, provide a more precise treatment of reliability than classical statistics, which examine 
the issue from a global test level. The most reliable estimation of a test-taker’s ability can be 
gained from tests comprised of items that represent the fullest range of difficulty possible for the 
population for which the test is intended. Thus, to evaluate the technical adequacy of our MCRC 
measures, we looked for items representing a range of difficulties. In Rasch analyses, this 
information is gleaned from examining each item’s measure. Easy items will have measures 
represented with negative numbers; difficult items will have measures represented with positive 



numbers. A measure of zero indicates an item that a person of average ability would be expected 
to have a 50% chance of getting correct. Thus, we sought a full range of measure on every 
MCRC test form. 

Examining the standard error of measure. Rasch analyses also provide information 
about the standard error of measure associated with the estimation of each item’s measure. 
Generally, the smaller the standard error of measure, the more reliable the estimation is. We 
sought small standard errors of measure for all items on our MCRC tests. 

Using the mean square outfit to evaluate goodness of fit. An additional piece of 
information used to evaluate technical adequacy in a Rasch model is the mean square outfit 
associated with each item. Values in the range of 0.50 to 1.50 are considered acceptable fit. 
Mean square outfits falling outside this acceptable range indicate the need for further evaluation 
of item functioning. In general, items with a mean square outfit less than 0.50 are considered 
less worrisome than items with mean square outfits higher than 1.50 because items falling into 
the fonner category perfonn more consistently (e.g., every student regardless of ability gets the 
item correct or incorrect) compared to items in the latter category that function more 
inconsistently (e.g., students who perform poorly on all other items, always get the item correct) 
(Linacre, 2002). In all cases, distractor analysis provides useful information to further evaluate 
the technical adequacy of each item. 

Analyzing distractor selection information. A distractor analysis provides infonnation 
on the average estimated ability of test takers who selected a particular distractor on a test. In 
evaluating the technical adequacy of an assessment instrument, one hopes to see that the correct 
answer is selected by test-takers with the highest average estimated ability and the remaining 
distractors are selected by test- takers with lower estimated abilities. In addition, every distractor 



in a well-constructed measure will be selected by at least some test-takers. We considered all of 
these features in evaluating the technical adequacy of the MCRC measures. 

Analyzing person and item reliability. Rasch analyses report both the person and item 
reliability. The person reliability is equivalent to the traditional test reliability. Low values 
indicate a narrow range of person measures, or a small number of items. Therefore, testing 
persons with more extreme abilities (high and low) or lengthening the measure would increase 
the person reliability. Winsteps’ item reliability has no traditional equivalent. Low item 
reliability values indicate a narrow range of item measures or a small sample. A larger sample of 
persons would increase item reliability. Low item reliability means that the sample size is too 
small to precisely locate the items on the latent variable (i.e., ability). 

Results 

Grade 5 MCRC Equivalence by Form 

In this section we report findings concerning the equivalence of MCRC forms. We used 
one-way repeated measures ANOVA to evaluate equivalence of difficulty across the MCRC 
forms. Because like groups of students took three MCRC forms, each roughly one week apart, 
we evaluated the difficulty equivalence of each set of the three forms that were taken by the 
same group of students. Mean differences across fonns of 8, 9, and 10 were not significantly 
different. On the other hand, mean differences across forms of 1 1, 12, and 13 were statistically 
significant, F( 2, 138) = 26.34 ,p < .01. Forms 1 1 and 12 were significantly more difficult than 
form 13. Mean differences across forms of 13, 14, and 15 were also statistically significant, F( 2, 
106) = 434, p < .05. Forms 14 and 15 were significantly more difficult than form 16. Tables 1- 
8 in Appendix A display descriptive statistics and the complete results of repeated measures 



ANOVA, as well as post-hoc analyses conducted to compare mean differences for the grade 5 
MCRC measures used in the study. 

Grade 5 MCRC Split-half Reliability 

In this section we report overall reliability of the MCRC measure based on internal 
consistency among items within each selected test form using split-half reliability coefficients 
calculated with the Guttman fonnula. Split-half reliability coefficients were computed by 
comparing the results from the first 10 items of the MCRC measure to the second 10 items for all 
students in the sample taking each form. Some coefficients were calculated based on less than 
20 items ( e.g ., forms 1 1, 12 and 15 in grade 5) if a given item did not have enough variance to 
calculate reliability. For grade 5 MCRC forms 8 through 16, Guttman split-half reliability 
coefficients ranged from .29 to .83. Specifically, the split-half coefficient for form 8 was .29 (n 
= 20 items); the split-half coefficient for form 9 was .79 (n = 20 items); the split-half coefficient 
for form 10 was .75 (n = 20 items); the split-half coefficient for form 1 1 was .60 (n = 19 items); 
the split-half coefficient for form 12 was .33 (n =18 items); the split-half coefficient for form 13 
was .67 (n = 20 items); the split-half coefficient for form 14 was .83 (n = 20 items); the split- 
half coefficient for fonn 15 was .57 (n =18 items); the split-half coefficient for form 16 was .59 
(n = 20 items). Tables 1-18 in Appendix B display descriptive statistics and complete results of 
split-half reliability analyses by form for grade 5 MCRC measures used in this study. 

Grade 5 Top-bottom Reliability 

In this section we report results from top-bottom reliability analysis used to evaluate the 
appropriateness of items. The proportion of correct responses of each item for low-perfonning 
(at or below the 23rd percentile) and high-performing (at or above the 78th percentile) students 
was evaluated from this analysis to examine the appropriateness of item functioning. For form 8, 



all students in the low-perfonning group answered 1 out of 20 items correctly; the proportion of 
correct responses for the remaining 19 items ranged from .18 to .91. Every student in the high- 
performing group answered 1 1 out of 20 items correctly, and the proportion of correct responses 
for the remaining 9 items ranged from .73 to. 93. For form 9, the proportion of correct responses 
ranged from .07 to .88 for the low-perfonning students. Every student in the high-performing 
group answered 15 out of 20 items conectly, and the proportion of correct responses for the 
remaining 5 items ranged from .56 to .88. For form 10, all students in the low-performing group 
answered 1 out of 20 items correctly; the proportion of correct responses for the remaining 19 
items ranged from .12 to .83. All students in the high-perfonning group answered 1 1 out of 20 
items conectly, and the proportion of correct responses for the remaining 9 items ranged from 
.33 to .94. For form 1 1, all students in the low-performing group answered 1 out of 20 items 
conectly; the proportion of correct responses for the remaining 19 items ranged from .45 to .91. 
All students in the high-performing group answered 1 1 out of 20 items correctly, and the 
proportion of correct responses for the remaining 9 items ranged from .86 to .97. 

For form 12, all students in the low-performing group answered 3 out of 20 items 
conectly; the proportion of correct responses for the remaining 17 items ranged from .18 to .94. 
All students in the high-performing group answered 1 1 out of 20 items correctly, and the 
proportion of correct responses for the remaining 9 items ranged from .25 to .96. The proportion 
of correct responses for the item 18 was higher for the low-performing students (.29) than for 
high-perfonning students (.25). For fonn 13, the proportion of correct responses ranged from .24 
to .88 for the low-performing students in this group. All students in the high-performing group 
answered 7 out of 20 items correctly, and the proportion of correct responses for the remaining 
13 items ranged from. 70 to .96. For form 14, the proportion of correct responses ranged from 



.09 to .91 for the low-performing students in this group. All students in the high-performing 
group answered all 20 items correctly. For form 15, all students in the low-perfonning group 
answered 2 out of 20 items correctly; the proportion of correct responses ranged from .06 to .94 
for the remaining 18 items. All students in the high-performing group answered 9 out of 20 
items correctly, and the proportion of correct responses for the remaining 1 1 items ranged from 
.60 to .95. For fonn 16, the proportion of correct responses ranged from . 18 to .94 for the low- 
performing students in this group. All students in the high-performing group answered 10 out of 
20 items correctly, and the proportion of correct responses for the remaining 10 items ranged 
from .53 to .93. Tables 1-10 in Appendix C display mean and percentile scores and the complete 
top-bottom reliability results for the grade 5 MCRC forms used in this study. 

Grade 5 Item-level Rasch Analyses 

Almost all items on the grade 5 MCRC form 8 passed the pre-set adequate model fit 
selection criteria, falling within the mean square outfit range of 0.50 to 1.50. The exceptions 
were items #11 and #16, which had a mean square outfit of 2. 1 1 and 1 .62, respectively. 
Distractor analysis also indicated that these two items may not be functioning appropriately. 

Item #19 had mean square outfit of 0.40. Distractor analysis also suggested that this item might 
not be functioning well. A few items on grade 5 MCRC form 9 were not within the mean square 
outfit range of 0.50 to 1.50. Items #12 and #20 were over-fit, with mean square outfit values of 
6.75 and 1.91, respectively. Items #2, #9, #14, #17, and #18 were under-fit, with mean square 
outfit values of 0.28, 0.16, 0.18, 0.43, and 0.42, respectively. Distractor analysis however 
suggested that all of these items were functioning appropriately, though item #17 may not be. 

On grade 5 MCRC fonn 10, only item #18 was over- fit, with a mean square outfit of 1.59. Items 
#10, #14, #19, and #20 were under-fit, with mean square outfit values of 0.48, 0.18, 0.39, and 



0.47, respectively. Of these items, distractor analysis indicated that items #10, #14, and #19 may 
not be functioning appropriately. All but three items on the grade 5 MCRC fonn 1 1 were within 
the acceptable mean square outfit range of 0.50 to 1.50. The exceptions were items #5, #7, and 
#18, with mean square outfit values of 0.10, 0.23, and 0.29, respectively. Distractor analysis 
indicated that items #5 and #18 might not be functioning appropriately. 

On the grade 5 MCRC form 12, only item #18 exceeded the acceptable criteria of 1.50, 
with a mean square outfit of 2.59. Items #1, #4, and #15, on the other hand, had mean square 
outfit values below the acceptable criteria, 0.23, 0.27, and 0.35, respectively. Results from 
distractor analysis indicated that items #1, #4, and #15 might not be functioning appropriately. 
Items #2 and #18 on the grade 5 MCRC fonn 13 were over-fit, with mean square outfit of 2.09 
and 1.53, respectively. Item #7 was under-fit, with mean square outfit of 0.28. Distractor 
analysis, however, indicated that all of the items on this form were functioning appropriately. 
Almost all items on the grade 5 MCRC form 14 had mean square outfit values within the 
acceptable range of 0.50 and 1.50. Three items, #1, #5, and #14, were under fit, with mean 
square outfit values of 0.17, 0.09, and 0.33, respectively. Distractor analysis suggested that these 
items might not be functioning appropriately. On the grade 5 MCRC fonn 15, items #1, #4, #6, 
and #10 were over-fit, with mean square outfit of 2.31, 2.12, 2.5 and 1.51, respectively. 

Distractor analysis indicated that only items #1 and #4 might not be functioning appropriately. 
Items #5, #8, #17, and #20 were under-fit, with mean square outfit values of 0. 1 1, 0.25, 0.45, and 
0.30, respectively. Distractor analysis suggested that only items #5 and #8 might not be 
functioning appropriately. Almost all items on the grade 5 MCRC form 16 had mean square 
outfit values with in the acceptable range of 0.50 and 1.50. Only item #18 was over-fit, with a 
mean square outfit of 1.66. Items #3 and #6 were under-fit, with mean square outfit of 0.26 and 



0.47, respectively. Results from the distractor analysis indicated that these items are functioning 
appropriately. 

Person reliability values were low to high overall, ranging from 0.25 to 0.72. Item 
reliability was generally moderate, with values generally in the .80-. 90s. It should be noted that 
the sample sizes were small in general (n ranges 52-83). Tables 1-18 in Appendix D display the 
item measure, standard error of measure, mean square outfit, and complete distractor analyses for 
the nine grade 5 MCRC measures used in this study. 

Discussion 

Our findings in this study suggest that the grade 5 easyCBM multiple choice reading 
comprehension measures have acceptable levels of reliability for the two purposes for which 
they are intended: as one part of a battery of assessments administered in the fall, winter, and 
spring to screen students at risk for reading difficulty, and as repeated measures over time as 
used to monitor student progress in developing comprehension skill. Although we would have 
preferred to have even higher alternate fonn reliability coefficients, it appears likely that our 
results are dampened by two factors. First, sample sizes in our study were not as large as we 
would have liked, due to challenges related to participant recruitment. Second, it appears as 
though the test forms might have had a ceiling effect, with very little variation in scores for 
students who were in the top third (reducing the power of the top / bottom reliability analyses). 


Future research should address both these limitations. 
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Table 1 


Descriptive Statistics of Grade 5 Measures 8 to 10 



Mean 


Std. Deviation 

N 


total 8 


16.0000 


2.67375 


48 

total 9 


16.0000 


3.54305 


48 

total 10 


15.2917 


2.75957 


48 

Table 2 







Tests ofWithin-Subjects Effects for Grade 5 Measures 8 to 10 






Type III Sum of 





Source 


Squares 

df 

Mean Square 

F 

Sig. 

forms 

Sphericity Assumed 

16.056 

2 

8.028 

1.932 

.151 


Greenhouse-Geisser 

16.056 

1.964 

8.174 

1.932 

.151 


Huynh-Feldt 

16.056 

2.000 

8.028 

1.932 

.151 


Lower-bound 

16.056 

1.000 

16.056 

1.932 

.171 

Error(forms) 

Sphericity Assumed 

390.611 

94 

4.155 




Greenhouse-Geisser 

390.611 

92.313 

4.231 




Huynh-Feldt 

390.611 

94.000 

4.155 




Lower-bound 

390.611 

47.000 

8.311 




2 

Note. Mauchly ’s Test of Sphericity: The assumption of sphericity was not violated, Mauchly's W was 0.98, % (2) = 


0.85, > .05. 



Table 3 


Descriptive Statistics of Grade 5 Measures 11 to 13 



Mean 


Std. Deviation 


N 


total 1 1 


17.6143 


2.32375 


70 

total 12 


16.2000 


2.41733 


70 

total 13 


15.1857 


3.06591 


70 

Table 4 







Tests of Within-Subjects Effects for Grade 5 Measures 11 to 13 






Type III Sum of 





Source 


Squares 

df Mean Square 

F 

Sig. 

forms 

Sphericity Assumed 

208.295 

2 

104.148 

26.337 

.000 


Greenhouse-Geisser 

208.295 

1.942 

107.277 

26.337 

.000 


Huynh-Feldt 

208.295 

1.997 

104.304 

26.337 

.000 


Lower-bound 

208.295 

1.000 

208.295 

26.337 

.000 

Error(forms) 

Sphericity Assumed 

545.705 

138 

3.954 




Greenhouse-Geisser 

545.705 

133.974 

4.073 




Huynh-Feldt 

545.705 

137.793 

3.960 




Lower-bound 

545.705 

69.000 

7.909 




2 

Note. Mauchly’s Test of Sphericity: The assumption of sphericity was not violated, Mauchly's W was 0.97, % (2) = 


2.0%, p > .05. 

Table 5 


Tests of Within-Subjects Contrasts for Grade 5 Measures 11 to 13 


Source 

forms 

Type III Sum of 
Squares 

df 

Mean Square 

F 

Sig. 

forms 

Level 1 vs. Level 3 

412.857 

1 

412.857 

44.711 

.000 


Level 2 vs. Level 3 

72.014 

1 

72.014 

9.538 

.003 

Error(forms) 

Level 1 vs. Level 3 

637.143 

69 

9.234 




Level 2 vs. Level 3 

520.986 

69 

7.551 





Table 6 

Descriptive Statistics of Grade 5 Measures 14 to 16 



Mean 


Std. Deviation 


N 


total 14 


15.9444 


4.02547 


54 

total 15 


15.9444 


2.94872 


54 

total 16 


14.7407 


3.85680 


54 

Table 7 







Tests of Within-Subjects Effects for Grade 5 Measures 14 to 16 






Type III Sum of 





Source 


Squares 

df Mean Square 

F 

Sig. 

forms 

Sphericity Assumed 

52.160 

2 

26.080 

4.339 

.015 


Greenhouse-Geisser 

52.160 

1.581 

33.000 

4.339 

.024 


Huynh-Feldt 

52.160 

1.621 

32.177 

4.339 

.023 


Lower-bound 

52.160 

1.000 

52.160 

4.339 

.042 

Error(forms) 

Sphericity Assumed 

637.173 

106 

6.011 




Greenhouse-Geisser 

637.173 

83.773 

7.606 




Huynh-Feldt 

637.173 

85.916 

7.416 




Lower-bound 

637.173 

53.000 

12.022 




Note. Mauchly’s Test of Sphericity: Mauchly's W was 0.74, ^ (2) = 16.03, < .05. Thus, for all within-subject 

effects, the Greenhouse-Geisser F was used. 


Table 8 


Tests of Within-Subjects Contrasts for Grade 5 Measures 14 to 16 


Source 

forms 

Type III Sum of 
Squares 

df 

Mean Square 

F 

Sig. 

forms 

Level 1 vs. Level 3 

78.241 

1 

78.241 

4.380 

.041 


Level 2 vs. Level 3 

78.241 

1 

78.241 

7.190 

.010 

Error(forms) 

Level 1 vs. Level 3 

946.759 

53 

17.863 




Level 2 vs. Level 3 

576.759 

53 

10.882 







Appendix B 


Table 1 

Grade 5 Split-Half Coefficients for MCRC Form 8 with N = 20 Items 


Cronbach's Alpha 

Part 1 Value 

.559 


N of Items 

10 a 


Part 2 Value 

.416 


N of Items 

10 b 


Total N of Items 

20 

Correlation Between Forms 


.170 

Spearman-Brown Coefficient 

Equal Length 

.291 


Unequal Length 

.291 

Guttman Split-Half Coefficient 


.288 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlOCorr. 

b. The items are: Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 

Table 2 


Grade 5 Split-Half Scale Statistics for MCRC Form 8 with N = 20 Items 


Mean 

Variance 

Std. Deviation 

N of Items 

Part 1 

8.28 

2.635 

1.623 

10 a 

Part 2 

8.14 

1.980 

1.407 

10 b 

Both Parts 

16.42 

5.392 

2.322 

20 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlO Corr. 

b. The items are: Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 



Table 3 

Grade 5 Split-Half Coefficients for MCRC Form 9 with N = 20 Items 


Cronbach's Alpha 

Part 1 Value 

.744 


N of Items 

10 a 


Part 2 Value 

.660 


N of Items 

10 b 


Total N of Items 

20 

Correlation Between Forms 


.656 

Spearman-Brown Coefficient 

Equal Length 

.793 


Unequal Length 

.793 

Guttman Split-Half Coefficient 


.790 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlOCorr. 

b. The items are: Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 

Table 4 


Grade 5 Split-Half Scale Statistics for MCRC Form 9 with N = 20 Items 


Mean 

Variance 

Std. Deviation 

N of Items 

Part 1 

8.82 

3.111 

1.764 

10 a 

Part 2 

7.31 

3.759 

1.939 

10 b 

Both Parts 

16.12 

11.360 

3.370 

20 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlO Corr. 

b. The items are: Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 



Table 5 

Grade 5 Split-Half Coefficients for MCRC Form 10 with N = 20 Items 


Cronbach's Alpha 

Part 1 Value 

.246 


N of Items 

10 a 


Part 2 Value 

.534 


N of Items 

10 b 


Total N of Items 

20 

Correlation Between Forms 


.644 

Spearman-Brown Coefficient 

Equal Length 

.783 


Unequal Length 

.783 

Guttman Split-Half Coefficient 


.749 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlOCorr. 

b. The items are: Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 

Table 6 


Grade 5 Split-Half Scale Statistics for MCRC Form 10 with A = 20 Items 


Mean 

Variance 

Std. Deviation 

N of Items 

Part 1 

8.40 

1.436 

1.198 

10 a 

Part 2 

7.10 

3.117 

1.765 

10 b 

Both Parts 

15.50 

7.277 

2.698 

20 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlO Corr. 

b. The items are: Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 



Table 7 

Grade 5 Split-Half Coefficients for MCRC Form 11 with N = 19 Items 


Cronbach's Alpha 

Part 1 Value 

.459 


N of Items 

9 a 


Part 2 Value 

.423 


N of Items 

10 b 


Total N of Items 

19 

Correlation Between Forms 


.431 

Spearman-Brown Coefficient 

Equal Length 

.603 


Unequal Length 

.603 

Guttman Split-Half Coefficient 


.602 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr. 

b. The items are: QlOCorr, Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, 
Q16_Corr, Q17_Corr, Q18_Corr, Q19_Corr. 


Table 8 

Grade 5 Split-Half Scale Statistics for MCRC Form 11 with N = 19 Items 

Mean Variance Std. Deviation N of Items 


Part 1 

7.86 

1.590 

1.261 

9 a 

Part 2 

9.03 

1.405 

1.185 

10 b 

Both Parts 

16.89 

4.285 

2.070 

19 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr. 

b. The items are: QlO Corr, Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, 
Q16_Corr, Q17_Corr, Q18_Corr, Q19_Corr. 



Table 9 

Grade 5 Split-Half Coefficients for MCRC Form 12 with N = 18 Items 


Cronbach's Alpha 

Part 1 Value 

.166 


N of Items 

8 a 


Part 2 Value 

.426 


N of Items 

10 b 


Total N of Items 

18 

Correlation Between Forms 


.218 

Spearman-Brown Coefficient 

Equal Length 

.358 


Unequal Length 

.359 

Guttman Split-Half Coefficient 


.333 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr. 

b. The items are: Q9_Corr, QlOCorr, Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, 
Q16_Corr, Q17_Corr, Q18_Corr. 


Table 10 

Grade 5 Split-Half Scale Statistics for MCRC Form 12 with N - 18 Items 

Mean Variance Std. Deviation N of Items 


Part 1 

7.00 

.896 

.946 

8 a 

Part 2 

7.69 

2.097 

1.448 

10 b 

Both Parts 

14.69 

3.590 

1.895 

18 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr. 

b. The items are: Q9_Corr, QlO Corr, Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, 
Q16_Corr, Q17_Corr, Q18_Corr. 



Table 1 1 

Grade 5 Split-Half Coefficients for MCRC Form 13 with N = 20 Items 


Cronbach's Alpha 

Part 1 Value 

.514 


N of Items 

10 a 


Part 2 Value 

.571 


N of Items 

10 b 


Total N of Items 

20 

Correlation Between Forms 


.510 

Spearman-Brown Coefficient 

Equal Length 

.675 


Unequal Length 

.675 

Guttman Split-Half Coefficient 


.669 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlOCorr. 

b. The items are: Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 

Table 12 


Grade 5 Split-Half Scale Statistics for MCRC Form 13 with A = 20 Items 


Mean 

Variance 

Std. Deviation 

N of Items 

Part 1 

8.16 

2.528 

1.590 

10 a 

Part 2 

7.43 

3.538 

1.881 

10 b 

Both Parts 

15.58 

9.114 

3.019 

20 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlO Corr. 

b. The items are: Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 



Table 13 

Grade 5 Split-Half Coefficients for MCRC Form 14 with N = 20 Items 


Cronbach's Alpha 

Part 1 Value 

.635 


N of Items 

10 a 


Part 2 Value 

.796 


N of Items 

10 b 


Total N of Items 

20 

Correlation Between Forms 


.755 

Spearman-Brown Coefficient 

Equal Length 

.860 


Unequal Length 

.860 

Guttman Split-Half Coefficient 


.825 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlOCorr. 

b. The items are: Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 

Table 14 


Grade 5 Split-Half Scale Statistics for MCRC Form 14 with N = 20 Items 


Mean 

Variance 

Std. Deviation 

N of Items 

Part 1 

8.57 

2.625 

1.620 

10 a 

Part 2 

7.90 

5.677 

2.383 

10 b 

Both Parts 

16.47 

14.129 

3.759 

20 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlO Corr. 

b. The items are: Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 



Table 15 

Grade 5 Split-Half Coefficients for MCRC Form 15 with N = 18 Items 


Cronbach's Alpha 

Part 1 Value 

.453 


N of Items 

8 a 


Part 2 Value 

.629 


N of Items 

10 b 


Total N of Items 

18 

Correlation Between Forms 


.448 

Spearman-Brown Coefficient 

Equal Length 

.619 


Unequal Length 

.621 

Guttman Split-Half Coefficient 


.569 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr. 

b. The items are: Q9_Corr, QlOCorr, Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, 
Q16_Corr, Q17_Corr, Q18_Corr. 


Table 16 

Grade 5 Split-Half Scale Statistics for MCRC Form 15 with N - 18 Items 

Mean Variance Std. Deviation N of Items 


Part 1 

7.08 

1.288 

1.135 

8 a 

Part 2 

7.38 

3.496 

1.870 

10 b 

Both Parts 

14.46 

6.685 

2.585 

18 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr. 

b. The items are: Q9_Corr, QlO Corr, Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, 
Q16_Corr, Q17_Corr, Q18_Corr. 



Table 17 

Grade 5 Split-Half Coefficients for MCRC Form 16 with N = 20 Items 


Cronbach's Alpha 

Part 1 Value 

.683 


N of Items 

10 a 


Part 2 Value 

.444 


N of Items 

10 b 


Total N of Items 

20 

Correlation Between Forms 


.421 

Spearman-Brown Coefficient 

Equal Length 

.592 


Unequal Length 

.592 

Guttman Split-Half Coefficient 


.591 


a. The items are: QlCorr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlOCorr. 

b. The items are: Q1 ICorr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 

Table 18 


Grade 5 Split-Half Scale Statistics for 

MCRC Form 16 with N = 20 Items 



Mean 

Variance 

Std. Deviation 

N of Items 

Part 1 

8.62 

2.830 

1.682 

10 a 

Part 2 

6.71 

3.268 

1.808 

10 b 

Both Parts 

15.33 

8.656 

2.942 

20 


a. The items are: Ql Corr, Q2_Corr, Q3_Corr, Q4_Corr, Q5_Corr, Q6_Corr, Q7_Corr, 
Q8_Corr, Q9_Corr, QlO Corr. 

b. The items are: Q1 I Corr, Q12_Corr, Q13_Corr, Q14_Corr, Q15_Corr, Q16_Corr, 
Q17_Corr, Q18_Corr, Q19_Corr, Q20_Corr. 



Appendix C 


p. 30 


Table 1 


Grade 5 Mean and the Percentile Scores by Form 


Form 

Mean ( n ) 

23 rd Percentile ( n ) 

78 th Percentile ( n ) 

8 

16.02 (51) 

15(11) 

18 (15) 

9 

15.96 (52) 

15(14) 

18 (16) 

10 

15.33 (52) 

14(12) 

17(18) 

11 

17.49 (77) 

16(11) 

19(29) 

12 

16.23 (82) 

15(17) 

18 (24) 

13 

15.36 (83) 

13 (17) 

18 (23) 

14 

16.00 (55) 

14(11) 

20(13) 

15 

16.02 (57) 

15 (18) 

18 (20) 

16 

14.73 (56) 

13(11) 

18 (15) 



p. 31 


Table 2 

Item Statistics for Students for Grade 5 Form 8 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.82 

.405 

11 

1.00 

.000 

15 

Q2_Corr 

.73 

.467 

11 

.93 

.258 

15 

Q3_Corr 

.45 

.522 

11 

1.00 

.000 

15 

Q4_Corr 

.91 

.302 

11 

1.00 

.000 

15 

Q5_Corr 

.64 

.505 

11 

1.00 

.000 

15 

Q6_Corr 

.64 

.505 

11 

.80 

.414 

15 

Q7_Corr 

.45 

.522 

11 

.73 

.458 

15 

Q8_Corr 

.91 

.302 

11 

1.00 

.000 

15 

Q9_Corr 

.45 

.522 

11 

.93 

.258 

15 

QlOCorr 

.27 

.467 

11 

.93 

.258 

15 

QllCorr 

1.00 

.000 

11 

1.00 

.000 

15 

Q 1 2_Corr 

.73 

.467 

11 

1.00 

.000 

15 

Q13_Corr 

.55 

.522 

11 

.73 

.458 

15 

Q 1 4_Corr 

.91 

.302 

11 

1.00 

.000 

15 

Q15_Corr 

.36 

.505 

11 

.80 

.414 

15 

Q 1 6_Corr 

.91 

.302 

11 

.93 

.258 

15 

Q 1 7_Corr 

.91 

.302 

11 

1.00 

.000 

15 

Q 1 8_Corr 

.55 

.522 

11 

1.00 

.000 

15 

Q 1 9_Corr 

.91 

.302 

11 

1.00 

.000 

15 

Q20 Corr 

.18 

.405 

11 

.73 

.458 

15 
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Table 3 

Item Statistics for Students for Grade 5 Form 9 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.86 

.363 

14 

1.00 

.000 

16 

Q2_Corr 

.64 

.497 

14 

1.00 

.000 

16 

Q3_Corr 

.86 

.363 

14 

1.00 

.000 

16 

Q4_Corr 

.50 

.519 

14 

1.00 

.000 

16 

Q5_Corr 

.64 

.497 

14 

.88 

.342 

16 

Q6_Corr 

.86 

.363 

14 

1.00 

.000 

16 

Q7_Corr 

.64 

.497 

14 

1.00 

.000 

16 

Q8_Corr 

.64 

.497 

14 

1.00 

.000 

16 

Q9_Corr 

.79 

.426 

14 

1.00 

.000 

16 

QlOCorr 

.57 

.514 

14 

1.00 

.000 

16 

QllCorr 

.36 

.497 

14 

1.00 

.000 

16 

Q 1 2_Corr 

.07 

.267 

14 

.56 

.512 

16 

Q13_Corr 

.43 

.514 

14 

.94 

.250 

16 

Q 1 4_Corr 

.79 

.426 

14 

1.00 

.000 

16 

Q15_Corr 

.50 

.519 

14 

.75 

.447 

16 

Q 1 6_Corr 

.50 

.519 

14 

1.00 

.000 

16 

Q 1 7_Corr 

.71 

.469 

14 

1.00 

.000 

16 

Q 1 8_Corr 

.86 

.363 

14 

1.00 

.000 

16 

Q 1 9_Corr 

.57 

.514 

14 

1.00 

.000 

16 

Q20 Corr 

.21 

.426 

14 

.81 

.403 

16 
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Table 4 

Item Statistics for Students for Grade 5 Form 10 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.83 

.389 

12 

1.00 

.000 

18 

Q2_Corr 

.83 

.389 

12 

1.00 

.000 

18 

Q3_Corr 

1.00 

.000 

12 

.94 

.236 

18 

Q4_Corr 

.25 

.452 

12 

.94 

.236 

18 

Q5_Corr 

.58 

.515 

12 

1.00 

.000 

18 

Q6_Corr 

.42 

.515 

12 

.61 

.502 

18 

Q7_Corr 

.92 

.289 

12 

1.00 

.000 

18 

Q8_Corr 

.75 

.452 

12 

1.00 

.000 

18 

Q9_Corr 

.67 

.492 

12 

.94 

.236 

18 

QlOCorr 

.67 

.492 

12 

1.00 

.000 

18 

QllCorr 

.42 

.515 

12 

.78 

.428 

18 

Q 1 2_Corr 

.33 

.492 

12 

.72 

.461 

18 

Q13_Corr 

.25 

.452 

12 

.72 

.461 

18 

Q 1 4_Corr 

.83 

.389 

12 

1.00 

.000 

18 

Q15_Corr 

.50 

.522 

12 

1.00 

.000 

18 

Q 1 6_Corr 

.58 

.515 

12 

.83 

.383 

18 

Q 1 7_Corr 

.75 

.452 

12 

1.00 

.000 

18 

Q 1 8_Corr 

.17 

.389 

12 

.33 

.485 

18 

Q 1 9_Corr 

.67 

.492 

12 

1.00 

.000 

18 

Q20 Corr 

.42 

.515 

12 

1.00 

.000 

18 
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Table 5 

Item Statistics for Students for Grade 5 Form 11 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.45 

.522 

11 

.86 

.351 

29 

Q2_Corr 

.91 

.302 

11 

1.00 

.000 

29 

Q3_Corr 

.64 

.505 

11 

.86 

.351 

29 

Q4_Corr 

.73 

.467 

11 

1.00 

.000 

29 

Q5_Corr 

1.00 

.000 

11 

1.00 

.000 

29 

Q6_Corr 

.73 

.467 

11 

1.00 

.000 

29 

Q7_Corr 

.82 

.405 

11 

1.00 

.000 

29 

Q8_Corr 

.82 

.405 

11 

1.00 

.000 

29 

Q9_Corr 

.64 

.505 

11 

.97 

.186 

29 

QlOCorr 

.55 

.522 

11 

.86 

.351 

29 

QllCorr 

.91 

.302 

11 

1.00 

.000 

29 

Q 1 2_Corr 

.55 

.522 

11 

.97 

.186 

29 

Q13_Corr 

.82 

.405 

11 

.97 

.186 

29 

Q 1 4_Corr 

.82 

.405 

11 

.97 

.186 

29 

Q15_Corr 

.73 

.467 

11 

1.00 

.000 

29 

Q 1 6_Corr 

.64 

.505 

11 

1.00 

.000 

29 

Q 1 7_Corr 

.82 

.405 

11 

1.00 

.000 

29 

Q 1 8_Corr 

.82 

.405 

11 

1.00 

.000 

29 

Q 1 9_Corr 

.73 

.467 

11 

.93 

.258 

29 

Q20 Corr 

.64 

.505 

11 

.97 

.186 

29 
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Table 6 

Item Statistics for Students for Grade 5 Form 12 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.94 

.243 

17 

1.00 

.000 

24 

Q2_Corr 

1.00 

.000 

17 

1.00 

.000 

24 

Q3_Corr 

.88 

.332 

17 

1.00 

.000 

24 

Q4_Corr 

1.00 

.000 

17 

1.00 

.000 

24 

Q5_Corr 

1.00 

.000 

17 

1.00 

.000 

24 

Q6_Corr 

.65 

.493 

17 

.88 

.338 

24 

Q7_Corr 

.94 

.243 

17 

1.00 

.000 

24 

Q8_Corr 

.76 

.437 

17 

.96 

.204 

24 

Q9_Corr 

.35 

.493 

17 

.88 

.338 

24 

QlOCorr 

.47 

.514 

17 

1.00 

.000 

24 

QllCorr 

.71 

.470 

17 

1.00 

.000 

24 

Q 1 2_Corr 

.71 

.470 

17 

.96 

.204 

24 

Q13_Corr 

.71 

.470 

17 

1.00 

.000 

24 

Q 1 4_Corr 

.76 

.437 

17 

.88 

.338 

24 

Q15_Corr 

.82 

.393 

17 

1.00 

.000 

24 

Q 1 6_Corr 

.59 

.507 

17 

.96 

.204 

24 

Q 1 7_Corr 

.82 

.393 

17 

1.00 

.000 

24 

Q 1 8_Corr 

.29 

.470 

17 

.25 

.442 

24 

Q 1 9_Corr 

.53 

.514 

17 

.83 

.381 

24 

Q20 Corr 

.18 

.393 

17 

.83 

.381 

24 
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Table 7 

Item Statistics for Students for Grade 5 Form 13 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.65 

.493 

17 

1.00 

.000 

23 

Q2_Corr 

.88 

.332 

17 

.96 

.209 

23 

Q3_Corr 

.65 

.493 

17 

.74 

.449 

23 

Q4_Corr 

.35 

.493 

17 

1.00 

.000 

23 

Q5_Corr 

.29 

.470 

17 

.96 

.209 

23 

Q6_Corr 

.35 

.493 

17 

1.00 

.000 

23 

Q7_Corr 

.82 

.393 

17 

1.00 

.000 

23 

Q8_Corr 

.88 

.332 

17 

1.00 

.000 

23 

Q9_Corr 

.71 

.470 

17 

.96 

.209 

23 

QlOCorr 

.35 

.493 

17 

.96 

.209 

23 

QllCorr 

.71 

.470 

17 

.96 

.209 

23 

Q 1 2_Corr 

.76 

.437 

17 

1.00 

.000 

23 

Q13_Corr 

.24 

.437 

17 

.87 

.344 

23 

Q 1 4_Corr 

.29 

.470 

17 

.91 

.288 

23 

Q15_Corr 

.47 

.514 

17 

.91 

.288 

23 

Q 1 6_Corr 

.35 

.493 

17 

1.00 

.000 

23 

Q 1 7_Corr 

.24 

.437 

17 

.70 

.470 

23 

Q 1 8_Corr 

.82 

.393 

17 

.91 

.288 

23 

Q 1 9_Corr 

.71 

.470 

17 

.96 

.209 

23 

Q20 Corr 

.47 

.514 

17 

.83 

.388 

23 
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Table 8 

Item Statistics for Students for Grade 5 Form 14 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.91 

.302 

11 

1.00 

.000 

13 

Q2_Corr 

.55 

.522 

11 

1.00 

.000 

13 

Q3_Corr 

.82 

.405 

11 

1.00 

.000 

13 

Q4_Corr 

.55 

.522 

11 

1.00 

.000 

13 

Q5_Corr 

.91 

.302 

11 

1.00 

.000 

13 

Q6_Corr 

.45 

.522 

11 

1.00 

.000 

13 

Q7_Corr 

.27 

.467 

11 

1.00 

.000 

13 

Q8_Corr 

.91 

.302 

11 

1.00 

.000 

13 

Q9_Corr 

.55 

.522 

11 

1.00 

.000 

13 

QlOCorr 

.55 

.522 

11 

1.00 

.000 

13 

QllCorr 

.27 

.467 

11 

1.00 

.000 

13 

Q 1 2_Corr 

.45 

.522 

11 

1.00 

.000 

13 

Q13_Corr 

.36 

.505 

11 

1.00 

.000 

13 

Q 1 4_Corr 

.82 

.405 

11 

1.00 

.000 

13 

Q15_Corr 

.45 

.522 

11 

1.00 

.000 

13 

Q 1 6_Corr 

.45 

.522 

11 

1.00 

.000 

13 

Q 1 7_Corr 

.27 

.467 

11 

1.00 

.000 

13 

Q 1 8_Corr 

.09 

.302 

11 

1.00 

.000 

13 

Q 1 9_Corr 

.55 

.522 

11 

1.00 

.000 

13 

Q20 Corr 

.55 

.522 

11 

1.00 

.000 

13 
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Table 9 

Item Statistics for Students for Grade 5 Form 15 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.94 

.236 

18 

.95 

.224 

20 

Q2_Corr 

1.00 

.000 

18 

1.00 

.000 

20 

Q3_Corr 

.89 

.323 

18 

1.00 

.000 

20 

Q4_Corr 

.94 

.236 

18 

1.00 

.000 

20 

Q5_Corr 

.94 

.236 

18 

1.00 

.000 

20 

Q6_Corr 

.78 

.428 

18 

.95 

.224 

20 

Q7_Corr 

.56 

.511 

18 

1.00 

.000 

20 

Q8_Corr 

1.00 

.000 

18 

1.00 

.000 

20 

Q9_Corr 

.50 

.514 

18 

.95 

.224 

20 

QlOCorr 

.72 

.461 

18 

.90 

.308 

20 

QllCorr 

.78 

.428 

18 

.95 

.224 

20 

Q 1 2_Corr 

.06 

.236 

18 

.80 

.410 

20 

Q13_Corr 

.28 

.461 

18 

.80 

.410 

20 

Q 1 4_Corr 

.67 

.485 

18 

.95 

.224 

20 

Q15_Corr 

.44 

.511 

18 

.85 

.366 

20 

Q 1 6_Corr 

.11 

.323 

18 

.60 

.503 

20 

Q 1 7_Corr 

.78 

.428 

18 

1.00 

.000 

20 

Q 1 8_Corr 

.89 

.323 

18 

.95 

.224 

20 

Q 1 9_Corr 

.61 

.502 

18 

1.00 

.000 

20 

Q20 Corr 

.78 

.428 

18 

1.00 

.000 

20 
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Table 10 

Item Statistics for Students for Grade 5 Form 16 




23 rd Percentile or Below 


78 th Percentile or Above 


Mean 

Std. Deviation 

N 

Mean 

Std. Deviation 

N 

QlCorr 

.91 

.302 

11 

1.00 

.000 

.15 

Q2_Corr 

.64 

.505 

11 

1.00 

.000 

.15 

Q3_Corr 

.82 

.405 

11 

1.00 

.000 

.15 

Q4_Corr 

.18 

.405 

11 

.93 

.258 

15 

Q5_Corr 

.73 

.467 

11 

1.00 

.000 

.15 

Q6_Corr 

.73 

.467 

11 

1.00 

.000 

.15 

Q7_Corr 

.82 

.405 

11 

1.00 

.000 

.15 

Q8_Corr 

.45 

.522 

11 

1.00 

.000 

.15 

Q9_Corr 

.18 

.405 

11 

.93 

.258 

15 

QlOCorr 

.73 

.467 

11 

1.00 

.000 

.15 

QllCorr 

.82 

.405 

11 

1.00 

.000 

.15 

Q 1 2_Corr 

.27 

.467 

11 

.87 

.352 

15 

Q13_Corr 

.36 

.505 

11 

.53 

.516 

15 

Q 1 4_Corr 

.64 

.505 

11 

.93 

.258 

15 

Q15_Corr 

.45 

.522 

11 

1.00 

.000 

.15 

Q 1 6_Corr 

.36 

.505 

11 

.80 

.414 

15 

Q 1 7_Corr 

.27 

.467 

11 

.93 

.258 

15 

Q 1 8_Corr 

.55 

.522 

11 

.60 

.507 

15 

Q 1 9_Corr 

.36 

.505 

11 

.80 

.414 

15 

Q20 Corr 

.36 

.505 

11 

.93 

.258 

15 
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Table 1 

Item Statistics, Entry Order, Grade 5 MCRC Form 8 


Item Number 

Raw Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

45 

54 

-0.39 

-0.98 

0.52 

2 

44 

54 

-0.19 

-0.24 

0.83 

3 

39 

54 

0.58 

-0.83 

0.76 

4 

47 

54 

-0.89 

-0.68 

0.51 

5 

42 

54 

0.15 

-0.75 

0.71 

6 

33 

54 

1.27 

0.73 

1.13 

7 

34 

54 

1.16 

2.17 

1.47 

8 

49 

54 

-1.68 

-0.01 

0.69 

9 

42 

54 

0.15 

-0.19 

0.89 

10 

36 

54 

0.94 

0.06 

1.00 

11 

50 

54 

-2.43 

1.07 

2.11 

12 

47 

54 

-0.89 

-0.39 

0.64 

13 

24 

54 

2.15 

2.95 

1.53 

14 

45 

54 

-0.39 

1.11 

1.55 

15 

32 

54 

1.37 

-0.25 

0.95 

16 

48 

54 

-1.23 

0.92 

1.62 

17 

44 

54 

-0.19 

-0.06 

0.91 

18 

42 

54 

0.15 

-1.52 

0.51 

19 

49 

54 

-1.68 

-0.44 

0.40 

20 

25 

54 

2.06 

-0.44 

0.93 



Table 2 


Distractor Analysis, Grade 5 MCRC Form 8 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


A 

0 

1 

2 

0.27 

0.00 

1 

B 

0 

1 

2 

0.81 

0.00 

C 

1 

45 

83 

2.19 

0.15 


Missing 

** 

7 

13 

-1.71 

1.14 


B 

0 

2 

4 

0.00 

0.53 


C 

0 

4 

7 

1.46 

0.50 

L 

A 

1 

44 

81 

2.19 

0.15 


Missing 

** 

4 

7 

-3.57 

1.28 


A 

0 

5 

9 

0.88 

0.45 

'l 

B 

0 

6 

11 

1.34 

0.33 


C 

1 

39 

72 

2.30 

0.16 


Missing 

** 

4 

7 

-3.57 

1.28 


A 

0 

1 

2 

0.01 

0.00 

A 

C 

0 

1 

2 

-0.53 

0.00 

<4 

B 

1 

47 

87 

2.15 

0.14 


Missing 

** 

5 

9 

-2.5 

1.46 


C 

0 

2 

4 

1.81 

0.39 


A 

0 

6 

11 

0.76 

0.34 


B 

1 

42 

78 

2.24 

0.15 


Missing 

** 

4 

7 

-3.57 

1.28 


A 

0 

8 

15 

1.54 

0.17 


B 

0 

8 

15 

1.62 

0.39 

0 

C 

1 

33 

61 

2.24 

0.20 


Missing 

** 

5 

9 

-2.31 

1.60 


B 

0 

6 

11 

1.12 

0.43 

n 

C 

0 

10 

19 

2.20 

0.29 

/ 

A 

1 

34 

63 

2.16 

0.18 


Missing 

** 

4 

7 

-3.57 

1.28 


B 

0 

0 

0 

0.00 

0.00 

8 

A 

0 

1 

2 

0.54 

0.00 

C 

1 

49 

91 

2.05 

0.16 


Missing 

** 

4 

7 

-3.28 

1.57 


A 

0 

4 

7 

1.09 

0.56 

o 

B 

0 

4 

7 

0.97 

0.51 

y 

C 

1 

42 

78 

2.21 

0.16 


Missing 

** 

4 

7 

-3.28 

1.57 


A 

0 

1 

2 

0.27 

0.00 

10 

C 

0 

13 

24 

1.50 

0.20 

B 

1 

36 

67 

2.25 

0.19 


Missing 

** 

4 

7 

-3.28 

1.57 



Table 2 


Distractor Analysis, Grade 5 MCRC Form 8 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

0 

0 

0.00 

0.00 

11 

A 

0 

1 

2 

2.20 

0.00 

B 

1 

50 

93 

2.00 

0.16 


Missing 

** 

3 

6 

-4.85 

0.00 


B 

0 

2 

4 

1.02 

0.76 

12 

C 

0 

2 

4 

0.56 

0.55 

A 

1 

47 

87 

2.11 

0.15 


Missing 

** 

3 

6 

-4.85 

0.00 


B 

0 

13 

24 

1.67 

0.27 

13 

C 

0 

14 

26 

2.03 

0.20 

A 

1 

24 

44 

2.18 

0.27 


Missing 

** 

3 

6 

-4.85 

0.00 


C 

0 

2 

4 

0.84 

1.36 

14 

B 

0 

3 

6 

1.94 

0.26 

A 

1 

45 

83 

2.05 

0.16 


Missing 

** 

4 

7 

-2.95 

1.89 


A 

0 

9 

17 

1.27 

0.31 

15 

B 

0 

10 

19 

1.52 

0.30 

C 

1 

32 

59 

2.37 

0.18 


Missing 

** 

3 

6 

-4.85 

0.00 


A 

0 

0 

0 

0.00 

0.00 

16 

C 

0 

3 

6 

1.51 

0.80 

B 

1 

48 

89 

2.04 

0.16 


Missing 

** 

3 

6 

-4.85 

0.00 


C 

0 

0 

0 

0.00 

0.00 

17 

A 

0 

6 

11 

1.17 

0.45 

B 

1 

44 

81 

2.15 

0.16 


Missing 

** 

4 

7 

-3.43 

1.41 


B 

0 

2 

4 

-0.13 

0.40 

18 

C 

0 

6 

11 

0.73 

0.33 

A 

1 

42 

78 

2.32 

0.14 


Missing 

** 

4 

7 

-3.43 

1.41 


B 

0 

0 

0 

0.00 

0.00 

19 

A 

0 

1 

2 

0.01 

0.00 

C 

1 

49 

91 

2.07 

0.15 


Missing 

** 

4 

7 

-3.43 

1.41 


A 

0 

4 

7 

1.92 

0.48 

20 

B 

0 

21 

39 

1.45 

0.19 

C 

1 

25 

46 

2.53 

0.21 


Missing 

** 

4 

7 

-3.43 

1.41 
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Table 3 

Item Statistics, Entry Order, Grade 5 MCRC Form 9 


Item Number 

Raw Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

49 

52 

-1.56 

0.36 

0.98 

2 

46 

52 

-0.59 

-1.29 

0.28 

3 

47 

52 

-0.86 

0.74 

1.43 

4 

43 

52 

0.05 

-0.58 

0.68 

5 

40 

52 

0.55 

1.16 

1.44 

6 

49 

52 

-1.56 

0.63 

1.31 

7 

45 

52 

-0.35 

-0.66 

0.56 

8 

45 

52 

-0.35 

-0.79 

0.51 

9 

49 

52 

-1.56 

-0.83 

0.16 

10 

43 

52 

0.05 

-0.01 

0.92 

11 

40 

52 

0.55 

-0.94 

0.66 

12 

12 

52 

4.11 

3.94 

6.75 

13 

41 

52 

0.40 

0.57 

1.19 

14 

48 

52 

-1.18 

-1.08 

0.18 

15 

30 

52 

1.80 

1.00 

1.24 

16 

38 

52 

0.84 

0.56 

1.15 

17 

48 

52 

-1.18 

-0.47 

0.43 

18 

49 

52 

-1.56 

-0.28 

0.42 

19 

43 

52 

0.05 

-0.18 

0.84 

20 

25 

52 

2.35 

2.62 

1.91 



Table 4 


Distractor Analysis, Grade 5 MCRC Form 9 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


A 

0 

1 

2 

0.71 

0.00 

1 

C 

0 

2 

4 

1.20 

0.18 

B 

1 

49 

94 

2.33 

0.24 


Missing 

** 

0 

0 

0.00 

0.00 


A 

0 

1 

2 

-0.66 

0.00 


C 

0 

5 

10 

-0.50 

0.47 

L 

B 

1 

46 

88 

2.62 

0.20 


Missing 

** 

0 

0 

0.00 

0.00 


B 

0 

2 

4 

2.30 

0.00 

'l 

C 

0 

3 

6 

-0.41 

1.10 


A 

1 

47 

90 

2.42 

0.23 


Missing 

** 

0 

0 

0.00 

0.00 


A 

0 

3 

6 

-0.26 

0.86 

A 

C 

0 

6 

12 

0.70 

0.57 

<4 

B 

1 

43 

83 

2.65 

0.22 


Missing 

** 

0 

0 

0.00 

0.00 


B 

0 

3 

6 

1.90 

0.77 


A 

0 

9 

17 

1.07 

0.58 


C 

1 

40 

77 

2.55 

0.25 


Missing 

** 






C 

0 

0 

0 

0.00 

0.00 


A 

0 

3 

6 

0.50 

1.11 

0 

B 

1 

49 

94 

2.36 

0.23 


Missing 

** 






B 

0 

1 

2 

-0.66 

0.00 

n 

A 

0 

6 

12 

0.37 

0.44 

/ 

C 

1 

45 

87 

2.57 

0.23 


Missing 

** 






B 

0 

2 

4 

0.90 

0.48 

8 

C 

0 

5 

10 

-0.40 

0.61 

A 

1 

45 

87 

2.61 

0.21 


Missing 

** 






C 

0 

1 

2 

-0.39 

0.00 

o 

B 

0 

2 

4 

-1.51 

0.00 

y 

A 

1 

49 

94 

2.46 

0.21 


Missing 

** 






B 

0 

2 

4 

-0.82 

0.69 

10 

A 

0 

7 

13 

1.23 

0.34 

C 

1 

43 

83 

2.56 

0.24 


Missing 

** 







Table 4 


Distractor Analysis, Grade 5 MCRC Form 9 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

5 

10 

-0.09 

0.51 

11 

B 

0 

7 

13 

0.95 

0.49 

A 

1 

40 

77 

2.78 

0.22 


Missing 

** 






A 

0 

10 

19 

1.41 

0.30 

12 

C 

1 

12 

23 

3.63 

0.64 

B 

0 

30 

58 

1.99 

0.23 


Missing 

** 






B 

0 

3 

6 

0.71 

1.70 

13 

A 

0 

7 

13 

0.12 

0.35 

C 

1 

41 

79 

2.75 

0.21 


Missing 

** 

1 

2 

1.38 

0.00 


B 

0 

2 

4 

-0.39 

0.26 

14 

C 

0 

2 

4 

-1.51 

0.00 

A 

1 

48 

92 

2.52 

0.21 


Missing 

** 






B 

0 

2 

4 

0.70 

1.09 

15 

A 

0 

19 

37 

1.70 

0.31 

C 

1 

30 

58 

2.81 

0.30 


Missing 

** 

1 

2 

-0.66 

0.00 


C 

0 

6 

12 

1.21 

0.28 

16 

A 

0 

8 

15 

1.11 

0.51 

B 

1 

38 

73 

2.66 

0.27 


Missing 

** 






B 

0 

2 

4 

-1.51 

0.00 

17 

C 

0 

2 

4 

0.62 

0.75 

A 

1 

48 

92 

2.48 

0.22 


Missing 

** 






A 

0 

1 

2 

-1.51 

0.00 

18 

B 

0 

2 

4 

0.18 

0.84 

C 

1 

49 

94 

2.42 

0.22 


Missing 

** 






C 

0 

1 

2 

2.30 

0.00 

19 

B 

0 

8 

15 

0.42 

0.39 

A 

1 

43 

83 

2.59 

0.24 


Missing 

** 






A 

0 

13 

25 

1.56 

0.40 

20 

C 

0 

13 

25 

1.38 

0.29 

B 

1 

25 

48 

3.07 

0.34 


Missing 

** 

1 

2 

2.30 

0.00 
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Table 5 

Item Statistics, Entry Order, Grade 5 MCRC Form 10 


Item Number 

Raw 

Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

46 

52 

-0.62 

-0.30 

0.73 

2 

48 

52 

-1.13 

0.21 

0.96 

3 

48 

52 

-1.13 

0.82 

1.50 

4 

29 

52 

1.53 

-0.44 

0.91 

5 

44 

52 

-0.24 

-0.58 

0.68 

6 

26 

52 

1.82 

1.19 

1.21 

7 

51 

52 

-2.68 

0.40 

0.91 

8 

49 

52 

-1.47 

-0.23 

0.57 

9 

43 

52 

-0.08 

-0.20 

0.85 

10 

47 

52 

-0.86 

-0.74 

0.48 

11 

37 

52 

0.71 

0.42 

1.09 

12 

29 

52 

1.53 

1.91 

1.37 

13 

27 

52 

1.72 

-0.42 

0.92 

14 

50 

52 

-1.93 

-0.74 

0.18 

15 

43 

52 

-0.08 

-0.97 

0.59 

16 

31 

52 

1.34 

-0.08 

0.97 

17 

47 

52 

-0.86 

-0.21 

0.73 

18 

12 

52 

3.28 

1.54 

1.59 

19 

46 

52 

-0.62 

-1.17 

0.39 

20 

44 

52 

-0.24 

-1.24 

0.47 



Table 6 


Distractor Analysis, Grade 5 MCRC Form 10 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

0 

0 

0.00 

0.00 

1 

B 

0 

5 

10 

0.74 

0.32 

A 

1 

46 

88 

1.94 

0.16 


Missing 

** 

1 

2 

1.51 

0.00 


A 

0 

1 

2 

1.91 

0.00 


C 

0 

3 

6 

0.59 

0.75 

L 

B 

1 

48 

92 

1.89 

0.15 


Missing 

** 






B 

0 

0 

0 

0.00 

0.00 

'l 

A 

0 

4 

8 

1.58 

0.39 


C 

1 

48 

92 

1.83 

0.16 


Missing 

** 






B 

0 

5 

10 

0.59 

0.52 

A 

C 

0 

17 

33 

1.44 

0.13 

<4 

A 

1 

29 

56 

2.28 

0.20 


Missing 

** 

1 

2 

0.83 

0.00 


C 

0 

1 

2 

1.91 

0.00 


A 

0 

7 

13 

0.44 

0.35 


B 

1 

44 

85 

2.03 

0.15 


Missing 

** 






B 

0 

8 

15 

1.37 

0.39 


A 

0 

18 

35 

1.59 

0.23 

0 

C 

1 

26 

50 

2.11 

0.22 


Missing 

** 






A 

0 

0 

0 

0.00 

0.00 

n 

C 

0 

1 

2 

1.16 

0.00 

/ 

B 

1 

51 

98 

1.83 

0.15 


Missing 

** 






C 

0 

1 

2 

1.16 

0.00 

8 

A 

0 

2 

4 

0.24 

0.58 

B 

1 

49 

94 

1.89 

0.15 


Missing 

** 






A 

0 

4 

8 

0.26 

0.49 

o 

B 

0 

5 

10 

1.48 

0.26 

y 

C 

1 

43 

83 

2.00 

0.16 


Missing 

** 






C 

0 

0 

0 

0.00 

0.00 

10 

A 

0 

4 

8 

0.33 

0.39 

B 

1 

47 

90 

1.97 

0.15 


Missing 

** 

1 

2 

0.52 

0.00 



Table 6 


Distractor Analysis, Grade 5 MCRC Form 10 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

2 

4 

0.41 

0.75 

11 

B 

0 

13 

25 

1.38 

0.32 

A 

1 

37 

71 

2.05 

0.16 


Missing 

** 






B 

0 

9 

17 

2.17 

0.33 

12 

A 

0 

14 

27 

1.05 

0.31 

C 

1 

29 

56 

2.07 

0.17 


Missing 

** 






B 

0 

6 

12 

1.16 

0.55 

13 

C 

0 

18 

35 

1.40 

0.22 

A 

1 

27 

52 

2.27 

0.19 


Missing 

** 

1 

2 

0.83 

0.00 


B 

0 

0 

0 

0.00 

0.00 

14 

C 

0 

2 

4 

-0.62 

0.28 

A 

1 

50 

96 

1.91 

0.14 


Missing 

** 






C 

0 

3 

6 

0.86 

0.37 

15 

A 

0 

6 

12 

0.42 

0.40 

B 

1 

43 

83 

2.08 

0.15 


Missing 

** 






B 

0 

1 

2 

-0.34 

0.00 

16 

C 

0 

20 

38 

1.39 

0.20 

A 

1 

31 

60 

2.16 

0.19 


Missing 

** 






A 

0 

2 

4 

0.41 

0.75 

17 

C 

0 

2 

4 

1.33 

0.18 

B 

1 

47 

90 

1.92 

0.16 


Missing 

** 

1 

2 

0.83 

0.00 


B 

0 

12 

23 

1.25 

0.34 

18 

C 

1 

12 

23 

2.14 

0.34 

A 

0 

27 

52 

1.96 

0.19 


Missing 

** 

1 

2 

0.83 

0.00 


C 

0 

0 

0 

0.00 

0.00 

19 

B 

0 

5 

10 

0.06 

0.17 

A 

1 

46 

88 

2.03 

0.14 


Missing 

** 

1 

2 

0.83 

0.00 


C 

0 

2 

4 

0.12 

1.03 

20 

B 

0 

5 

10 

0.36 

0.24 

A 

1 

44 

85 

2.08 

0.14 


Missing 

** 

1 

2 

0.83 

0.00 
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Table 7 

Item Statistics, Entry Order, Grade 5 MCRC Form 11 


Item Number 

Raw 

Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

54 

77 

1.64 

2.35 

1.43 

2 

76 

77 

-2.50 

0.45 

0.98 

3 

63 

77 

0.82 

0.94 

1.25 

4 

70 

77 

-0.16 

-0.14 

0.86 

5 

76 

77 

-2.50 

-0.65 

0.10 

6 

65 

77 

0.59 

-0.35 

0.87 

7 

73 

77 

-0.89 

-1.39 

0.23 

8 

69 

77 

0.02 

-0.20 

0.86 

9 

70 

77 

-0.16 

0.31 

1.07 

10 

55 

77 

1.56 

0.97 

1.17 

11 

71 

77 

-0.37 

0.10 

0.96 

12 

66 

77 

0.47 

-0.40 

0.84 

13 

66 

77 

0.47 

0.49 

1.13 

14 

68 

77 

0.18 

-0.13 

0.90 

15 

69 

77 

0.02 

-1.16 

0.54 

16 

69 

77 

0.02 

-0.72 

0.67 

17 

70 

77 

-0.16 

0.02 

0.93 

18 

73 

77 

-0.89 

-1.21 

0.29 

19 

61 

77 

1.03 

0.90 

1.21 

20 

63 

77 

0.82 

0.51 

1.12 



Table 8 


Distractor Analysis, Grade 5 MCRC Form 11 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

9 

12 

2.28 

0.24 

1 

A 

0 

11 

14 

2.10 

0.36 

B 

1 

54 

70 

2.83 

0.17 


Missing 

** 

3 

4 

2.36 

0.51 


A 

0 

0 

0 

0.00 

0.00 


C 

0 

1 

1 

1.67 

0.00 

L 

B 

1 

76 

99 

2.65 

0.14 


Missing 

** 






C 

0 

1 

1 

-0.98 

0.00 

'l 

B 

0 

12 

16 

2.14 

0.33 


A 

1 

63 

82 

2.85 

0.12 


Missing 

** 

1 

1 

-0.70 

0.00 


B 

0 

1 

1 

-0.98 

0.00 

A 

A 

0 

5 

6 

2.04 

0.24 

<4 

C 

1 

70 

91 

2.78 

0.13 


Missing 

** 

1 

1 

-0.70 

0.00 


B 

0 

0 

0 

0.00 

0.00 


C 

0 

1 

1 

-0.70 

0.00 


A 

1 

76 

99 

2.68 

0.13 


Missing 

** 






C 

0 

1 

1 

1.05 

0.00 

/Z 

B 

0 

11 

14 

1.56 

0.38 

0 

A 

1 

65 

84 

2.85 

0.13 


Missing 

** 






A 

0 

1 

1 

-0.98 

0.00 

n 

B 

0 

2 

3 

0.32 

1.02 

/ 

C 

1 

73 

95 

2.80 

0.11 


Missing 

** 

1 

1 

-0.44 

0.00 


A 

0 

3 

4 

1.72 

0.33 

8 

C 

0 

4 

5 

1.45 

0.84 

B 

1 

69 

90 

2.79 

0.13 


Missing 

** 

1 

1 

-0.44 

0.00 


B 

0 

3 

4 

1.08 

1.06 

o 

C 

0 

4 

5 

1.34 

0.84 

y 

A 

1 

70 

91 

2.78 

0.12 


Missing 

** 






C 

0 

2 

3 

1.34 

0.00 

10 

B 

0 

19 

25 

2.12 

0.23 

A 

1 

55 

71 

2.92 

0.15 


Missing 

** 

1 

1 

-0.44 

0.00 



Table 8 


Distractor Analysis, Grade 5 MCRC Form 11 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


A 

0 

1 

1 

-0.70 

0.00 

11 

B 

0 

5 

6 

2.00 

0.16 

C 

Missing 

1 

** 

71 

92 

2.73 

0.13 


A 

0 

4 

5 

1.6 

0.17 

12 

C 

0 

5 

6 

1.55 

0.70 

B 

1 

66 

86 

2.86 

0.13 


Missing 

** 

2 

3 

0.31 

0.75 


C 

0 

0 

0 

0.00 

0.00 

13 

A 

0 

9 

12 

2.08 

0.23 

B 

1 

66 

86 

2.78 

0.14 


Missing 

** 

2 

3 

0.62 

1.05 


A 

0 

2 

3 

-0.71 

0.27 

14 

B 

0 

7 

9 

1.63 

0.49 

C 

Missing 

1 

** 

68 

88 

2.84 

0.12 


B 

0 

3 

4 

1.46 

0.20 

15 

C 

0 

4 

5 

0.61 

0.84 

A 

1 

69 

90 

2.85 

0.12 


Missing 

** 

1 

1 

-0.44 

0.00 


B 

0 

2 

3 

1.86 

0.19 

16 

A 

0 

5 

6 

1.07 

0.58 

C 

1 

69 

90 

2.82 

0.12 


Missing 

** 

1 

1 

-0.44 

0.00 


A 

0 

3 

4 

2.39 

0.17 

17 

B 

0 

3 

4 

-0.01 

0.84 

C 

1 

70 

91 

2.77 

0.13 


Missing 

** 

1 

1 

2.05 

0.00 


A 

0 

0 

0 

0.00 

0.00 

18 

C 

0 

3 

4 

-0.01 

0.84 

B 

1 

73 

95 

2.79 

0.11 


Missing 

** 

1 

1 

-0.44 

0.00 


A 

0 

1 

1 

1.34 

0.00 

19 

B 

0 

13 

17 

2.36 

0.16 

C 

1 

61 

79 

2.83 

0.14 


Missing 

** 

2 

3 

-0.57 

0.13 


A 

0 

4 

5 

1.75 

0.34 

20 

C 

0 

4 

5 

1.50 

0.83 

B 

1 

63 

82 

2.85 

0.14 


Missing 

** 

6 

8 

1.84 

0.54 
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Table 9 

Item Statistics, Entry Order, Grade 5 MCRC Form 12 


Item Number 

Raw 

Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

81 

82 

-2.77 

-0.40 

0.23 

2 

82 

82 

0.00 

0.00 

1.00 

3 

80 

82 

-2.04 

0.11 

0.76 

4 

80 

82 

-2.04 

-0.65 

0.27 

5 

80 

82 

-2.04 

0.55 

1.23 

6 

61 

82 

0.91 

0.64 

1.13 

7 

78 

82 

-1.28 

-0.30 

0.62 

8 

73 

82 

-0.31 

0.57 

1.21 

9 

52 

82 

1.55 

1.07 

1.17 

10 

63 

82 

0.74 

-0.68 

0.82 

11 

73 

82 

-0.31 

-0.34 

0.79 

12 

68 

82 

0.28 

-0.29 

0.87 

13 

72 

82 

-0.18 

-0.90 

0.62 

14 

71 

82 

-0.05 

0.82 

1.30 

15 

75 

82 

-0.63 

-1.41 

0.35 

16 

65 

82 

0.57 

-1.03 

0.72 

17 

74 

82 

-0.46 

-0.87 

0.56 

18 

18 

82 

3.83 

3.71 

2.59 

19 

51 

82 

1.61 

0.33 

1.04 

20 

35 

82 

2.61 

-0.40 

0.93 



Table 10 


Distractor Analysis, Grade 5 MCRC Form 12 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


c 

0 

0 

0 

O.oo 

O.oo 

1 

A 

0 

1 

1 

0.10 

O.oo 

B 

1 

81 

99 

2.26 

0.13 


Missing 

** 






B 

0 

0 

0 

0.00 

0.00 


C 

0 

0 

0 

0.00 

0.00 

L 

A 

1 

82 

100 

2.24 

0.13 


Missing 

** 






A 

0 

1 

1 

1.89 

0.00 

'l 

B 

0 

1 

1 

0.10 

0.00 


C 

1 

80 

98 

2.27 

0.13 


Missing 

** 






C 

0 

0 

0 

0.00 

0.00 

A 

B 

0 

2 

2 

0.25 

0.16 

<4 

A 

1 

80 

98 

2.29 

0.13 


Missing 

** 






B 

0 

0 

0 

0.00 

0.00 

c 

A 

0 

2 

2 

1.40 

1.00 


C 

1 

80 

98 

2.26 

0.13 


Missing 

** 






C 

0 

1 

1 

1.46 

0 


A 

0 

19 

23 

1.69 

0.25 

0 

B 

1 

61 

74 

2.45 

0.14 


Missing 

** 

1 

1 

0.73 

0 


C 

0 

0 

0 

0.00 

0.00 

n 

A 

0 

3 

4 

1.02 

0.52 

/ 

B 

1 

78 

95 

2.30 

0.13 


Missing 

** 

1 

1 

0.73 

0.00 


A 

0 

1 

1 

1.46 

0.00 

8 

B 

0 

7 

9 

1.51 

0.43 

C 

1 

73 

89 

2.32 

0.14 


Missing 







C 

0 

2 

2 

1.67 

0.21 

o 

B 

0 

28 

34 

1.80 

0.16 

y 

A 

1 

52 

63 

2.49 

0.17 


Missing 

** 






C 

0 

7 

9 

1.24 

0.25 

10 

A 

0 

12 

15 

1.37 

0.26 

B 

1 

63 

77 

2.52 

0.14 


Missing 

** 







Table 10 


Distractor Analysis, Grade 5 MCRC Form 12 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


A 

0 

1 

1 

0.41 

0.00 

11 

B 

0 

8 

10 

1.29 

0.29 

C 

Missing 

1 

** 

73 

89 

2.37 

0.13 


C 

0 

3 

4 

1.64 

0.77 

12 

B 

0 

6 

7 

0.98 

0.36 

A 

1 

68 

83 

2.48 

0.12 


Missing 

** 

5 

6 

0.82 

0.58 


B 

0 

4 

5 

1.01 

0.58 

13 

C 

0 

4 

5 

1.1 

0.25 

A 

1 

72 

88 

2.42 

0.13 


Missing 

** 

2 

2 

0.26 

0.47 


B 

0 

1 

1 

-0.21 

0.00 

14 

A 

0 

9 

11 

1.68 

0.42 

C 

1 

71 

87 

2.38 

0.13 


Missing 

** 

1 

1 

-0.21 

0.00 


A 

0 

0 

0 

0.00 

0.00 

15 

C 

0 

3 

4 

0.53 

0.39 

B 

1 

75 

91 

2.41 

0.12 


Missing 

** 

4 

5 

0.34 

0.24 


C 

0 

2 

2 

1.93 

0.47 

16 

B 

0 

10 

12 

1.22 

0.30 

A 

1 

65 

79 

2.54 

0.13 


Missing 

** 

5 

6 

0.42 

0.20 


C 

0 

0 

0 

0.00 

0.00 

17 

A 

0 

3 

4 

1.09 

0.75 

B 

1 

74 

90 

2.40 

0.12 


Missing 

** 

5 

6 

0.49 

0.24 


A 

1 

18 

22 

2.49 

0.38 

18 

C 

0 

21 

26 

2.48 

0.21 

B 

0 

38 

46 

2.20 

0.14 


Missing 

** 

5 

6 

0.65 

0.36 


A 

0 

3 

4 

1.08 

0.69 

19 

C 

0 

23 

28 

1.94 

0.21 

B 

1 

51 

62 

2.62 

0.15 


Missing 

** 

5 

6 

0.42 

0.20 


B 

0 

0 

0 

0.00 

0.00 

20 

C 

1 

35 

43 

2.89 

0.18 

A 

0 

41 

50 

1.83 

0.14 


Missing 

** 

6 

7 

1.25 

0.59 
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Table 1 1 

Item Statistics, Entry Order, Grade 5 MCRC Form 13 


Item Number 

Raw 

Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

74 

83 

-0.85 

0.20 

1.02 

2 

76 

83 

-1.16 

1.72 

2.09 

3 

45 

83 

1.51 

3.21 

1.47 

4 

65 

83 

0.11 

-1.16 

0.71 

5 

57 

83 

0.73 

-0.70 

0.87 

6 

66 

83 

0.03 

-1.11 

0.70 

7 

80 

83 

-2.13 

-0.85 

0.28 

8 

80 

83 

-2.13 

0.01 

0.76 

9 

68 

83 

-0.16 

-0.01 

0.97 

10 

58 

83 

0.66 

0.41 

1.07 

11 

72 

83 

-0.59 

0.43 

1.12 

12 

70 

83 

-0.36 

-0.63 

0.76 

13 

51 

83 

1.13 

-0.36 

0.94 

14 

53 

83 

1.00 

-0.23 

0.96 

15 

63 

83 

0.28 

-0.36 

0.90 

16 

62 

83 

0.36 

-1.41 

0.70 

17 

32 

83 

2.33 

1.69 

1.31 

18 

76 

83 

-1.16 

1.03 

1.53 

19 

68 

83 

-0.16 

0.16 

1.02 

20 

59 

83 

0.58 

1.59 

1.33 



Table 12 


Distractor Analysis, Grade 5 MCRC Form 13 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

1 

1 

1.70 

0.00 

1 

B 

0 

8 

10 

0.90 

0.24 

A 

1 

74 

89 

1.83 

0.14 


Missing 

** 






B 

0 

2 

2 

1.61 

1.84 


A 

0 

4 

5 

0.80 

0.51 

L 

C 

1 

76 

92 

1.80 

0.14 


Missing 

** 

1 

1 

1.36 

0.00 


C 

0 

8 

10 

1.00 

0.32 

1 

A 

0 

30 

36 

1.61 

0.16 

j 

B 

1 

45 

54 

1.95 

0.21 


Missing 

** 






A 

0 

3 

4 

0.88 

0.63 

A 

C 

0 

15 

18 

0.49 

0.22 

‘A 

B 

1 

65 

78 

2.06 

0.13 


Missing 

** 






B 

0 

11 

13 

0.69 

0.21 


A 

0 

15 

18 

1.00 

0.26 


C 

1 

57 

69 

2.13 

0.15 


Missing 

** 






B 

0 

4 

5 

0.47 

0.27 


C 

0 

13 

16 

0.58 

0.26 

0 

A 

1 

66 

80 

2.04 

0.14 


Missing 

** 






B 

0 

1 

1 

-0.76 

0.00 

n 

C 

0 

2 

2 

-0.11 

0.13 

/ 

A 

1 

80 

96 

1.81 

0.13 


Missing 

** 






A 

0 

1 

1 

1.06 

0.00 

8 

C 

0 

2 

2 

0.65 

0.13 

B 

1 

80 

96 

1.77 

0.14 


Missing 

** 






C 

0 

1 

1 

1.06 

0 

o 

A 

0 

13 

16 

0.78 

0.31 

7 

B 

1 

68 

82 

1.95 

0.14 


Missing 

** 

1 

1 

0.52 

0 


B 

0 

2 

2 

0.27 

0.51 

10 

A 

0 

22 

27 

1.13 

0.19 

C 

1 

58 

70 

2.06 

0.15 


Missing 

** 

1 

1 

-0.76 

0.00 



Table 12 


Distractor Analysis, Grade 5 MCRC Form 13 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


B 

0 

3 

4 

0.62 

0.83 

11 

C 

0 

7 

8 

0.97 

0.46 

A 

1 

72 

87 

1.89 

0.13 


Missing 

** 

1 

1 

-0.76 

0.00 


C 

0 

3 

4 

0.49 

0.71 

12 

A 

0 

9 

11 

0.80 

0.27 

B 

1 

70 

84 

1.95 

0.14 


Missing 

** 

1 

1 

-0.76 

0.00 


B 

0 

8 

10 

0.65 

0.33 

13 

A 

0 

23 

28 

1.23 

0.18 

C 

1 

51 

61 

2.18 

0.16 


Missing 

** 

1 

1 

-0.76 

0.00 


C 

0 

12 

14 

0.67 

0.29 

14 

B 

0 

16 

19 

1.28 

0.24 

A 

1 

53 

64 

2.18 

0.15 


Missing 

** 

2 

2 

0.15 

0.91 


A 

0 

4 

5 

0.79 

0.16 

15 

B 

0 

15 

18 

0.89 

0.27 

C 

1 

63 

76 

2.04 

0.14 


Missing 

** 

1 

1 

-0.76 

0.00 


A 

0 

10 

12 

1.02 

0.21 

16 

B 

0 

10 

12 

0.43 

0.22 

C 

1 

62 

75 

2.10 

0.14 


Missing 

** 

1 

1 

-0.76 

0.00 


B 

0 

15 

18 

0.70 

0.14 

17 

A 

1 

32 

39 

2.37 

0.24 

C 

0 

34 

41 

1.67 

0.14 


Missing 

** 

2 

2 

0.47 

1.23 


A 

0 

3 

4 

0.63 

1.03 

18 

C 

0 

3 

4 

1.59 

0.55 

B 

1 

76 

92 

1.82 

0.13 


Missing 

** 

1 

1 

-0.76 

0.00 


C 

0 

5 

6 

0.90 

0.47 

19 

B 

0 

9 

11 

0.99 

0.34 

A 

1 

68 

82 

1.93 

0.14 


Missing 

** 

1 

1 

-0.76 

0.00 


C 

0 

8 

10 

0.77 

0.29 

20 

A 

0 

13 

16 

1.48 

0.34 

B 

1 

59 

71 

2.00 

0.15 


Missing 

** 

3 

4 

0.29 

0.61 
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Table 13 

Item Statistics, Entry Order, Grade 5 MCRC Form 14 


Item Number 

Raw 

Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

53 

55 

-2.16 

-0.48 

0.17 

2 

42 

55 

0.57 

0.04 

0.98 

3 

52 

55 

-1.66 

0.62 

1.30 

4 

47 

55 

-0.28 

0.91 

1.44 

5 

54 

55 

-2.95 

-0.68 

0.09 

6 

43 

55 

0.42 

0.80 

1.26 

7 

34 

55 

1.65 

1.22 

1.31 

8 

52 

55 

-1.66 

0.26 

0.89 

9 

46 

55 

-0.08 

-0.14 

0.87 

10 

43 

55 

0.42 

0.19 

1.03 

11 

36 

55 

1.40 

-0.61 

0.84 

12 

47 

55 

-0.28 

-0.70 

0.61 

13 

40 

55 

0.86 

-0.90 

0.74 

14 

51 

55 

-1.28 

-0.73 

0.33 

15 

39 

55 

1.00 

0.20 

1.03 

16 

45 

55 

0.09 

0.73 

1.27 

17 

41 

55 

0.72 

-0.34 

0.87 

18 

32 

55 

1.91 

0.58 

1.13 

19 

41 

55 

0.72 

-0.10 

0.94 

20 

42 

55 

0.57 

-0.32 

0.87 



Table 14 


Distractor Analysis, Grade 5 MCRC Form 14 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

0 

0 

0.00 

0.00 

1 

B 

0 

2 

4 

-1.28 

0.53 

A 

1 

53 

96 

2.49 

0.23 


Missing 

** 






C 

0 

3 

5 

0.24 

1.15 


A 

0 

10 

18 

0.93 

0.31 

L 

B 

1 

42 

76 

2.84 

0.25 


Missing 

** 






B 

0 

1 

2 

-0.18 

0.00 

'l 

C 

0 

2 

4 

0.19 

2.00 


A 

1 

52 

95 

2.48 

0.23 


Missing 

** 






C 

0 

0 

0 

0.00 

0.00 

A 

B 

0 

8 

15 

1.01 

0.37 

<4 

A 

1 

47 

85 

2.58 

0.26 


Missing 

** 






A 

0 

0 

0 

0.00 

0.00 


B 

0 

1 

2 

-1.80 

0.00 


C 

1 

54 

98 

2.43 

0.23 


Missing 

** 






C 

0 

3 

5 

0.63 

0.47 


A 

0 

9 

16 

1.01 

0.37 

0 

B 

1 

43 

78 

2.75 

0.26 


Missing 

** 






A 

0 

2 

4 

-0.17 

1.63 

n 

B 

0 

19 

35 

1.31 

0.32 

/ 

C 

1 

34 

62 

3.08 

0.26 


Missing 

** 






B 

0 

1 

2 

-0.75 

0 

8 

C 

0 

2 

4 

-0.01 

1.8 

A 

1 

52 

95 

2.5 

0.23 


Missing 

** 

0 

0 

0 

0 


A 

0 

4 

7 

0.34 

0.40 

o 

B 

0 

4 

7 

0.38 

0.50 

y 

C 

1 

46 

84 

2.71 

0.25 


Missing 

** 

1 

2 

1.79 

0.00 


C 

0 

4 

7 

0.68 

0.69 

10 

A 

0 

6 

11 

0.32 

0.32 

B 

1 

43 

78 

2.82 

0.25 


Missing 

** 

2 

4 

1.79 

0.00 



Table 14 


Distractor Analysis, Grade 5 MCRC Form 14 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

0 

0 

0.00 

0.00 

11 

A 

0 

17 

31 

0.87 

0.29 

B 

1 

36 

65 

3.16 

0.24 


Missing 

** 

2 

4 

0.52 

1.27 


B 

0 

1 

2 

0.35 

0.00 

12 

A 

0 

5 

9 

-0.14 

0.51 

C 

1 

47 

85 

2.74 

0.23 


Missing 

** 

2 

4 

0.52 

1.27 


B 

0 

5 

9 

0.96 

0.49 

13 

A 

0 

8 

15 

0.60 

0.47 

C 

1 

40 

73 

3.02 

0.23 


Missing 

** 

2 

4 

-0.47 

0.28 


C 

0 

0 

0 

0.00 

0.00 

14 

B 

0 

3 

5 

-0.63 

0.59 

A 

1 

51 

93 

2.58 

0.23 


Missing 

** 

1 

2 

-0.18 

0.00 


C 

0 

4 

7 

-0.66 

0.42 

15 

B 

0 

11 

20 

1.42 

0.32 

A 

1 

39 

71 

2.99 

0.24 


Missing 

** 

1 

2 

-0.18 

0 


C 

0 

2 

4 

-0.20 

0.55 

16 

A 

0 

7 

13 

0.74 

0.63 

B 

1 

45 

82 

2.77 

0.23 


Missing 

** 

1 

2 

-0.18 

0.00 


C 

0 

4 

7 

-0.11 

0.67 

17 

B 

0 

9 

16 

1.00 

0.34 

A 

1 

41 

75 

2.95 

0.24 


Missing 

** 

1 

2 

-0.18 

0.00 


B 

0 

9 

16 

1.1 

0.24 

18 

A 

0 

12 

22 

1.02 

0.46 

C 

1 

32 

58 

3.3 

0.26 


Missing 

** 

2 

4 

0.81 

0.99 


C 

0 

4 

7 

-0.46 

0.52 

19 

A 

0 

8 

15 

1.25 

0.41 

B 

1 

41 

75 

2.92 

0.24 


Missing 

** 

2 

4 

0.81 

0.99 


A 

0 

5 

9 

1.51 

0.28 

20 

B 

0 

6 

11 

-0.10 

0.50 

C 

1 

42 

76 

2.88 

0.24 


Missing 

** 

2 

4 

0.81 

0.99 



p. 61 


Table 15 


Item Statistics, Entry Order, Grade 5 MCRC Form 15 


Item Number 

Raw 

Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

54 

57 

-1.48 

1.27 

2.31 

2 

57 

57 

0.00 

0.00 

1.00 

3 

51 

57 

-0.60 

-0.17 

0.76 

4 

54 

57 

-1.48 

1.16 

2.12 

5 

56 

57 

-2.72 

-0.64 

0.11 

6 

52 

57 

-0.84 

1.68 

2.50 

7 

43 

57 

0.69 

-0.56 

0.80 

8 

56 

57 

-2.72 

-0.31 

0.25 

9 

41 

57 

0.93 

0.62 

1.16 

10 

46 

57 

0.29 

1.22 

1.51 

11 

49 

57 

-0.20 

0.45 

1.15 

12 

22 

57 

2.84 

1.40 

1.40 

13 

36 

57 

1.47 

0.24 

1.04 

14 

46 

57 

0.29 

0.15 

1.01 

15 

35 

57 

1.57 

0.33 

1.05 

16 

19 

57 

3.16 

0.65 

1.19 

17 

51 

57 

-0.60 

-0.85 

0.45 

18 

52 

57 

-0.84 

0.69 

1.37 

19 

45 

57 

0.43 

-0.88 

0.67 

20 

49 

57 

-0.20 

-1.68 

0.30 



Table 16 


Distractor Analysis, Grade 5 MCRC Form 15 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

0 

0 

0.00 

0.00 

1 

A 

0 

3 

5 

1.75 

0.74 

B 

1 

54 

95 

2.22 

0.19 


Missing 

** 






B 

0 

0 

0 

0.00 

0.00 


C 

0 

0 

0 

0.00 

0.00 

L 

A 

1 

57 

100 

2.19 

0.19 


Missing 

** 






A 

0 

2 

4 

0.43 

0.31 

'l 

B 

0 

3 

5 

1.10 

0.84 


C 

1 

51 

89 

2.38 

0.19 


Missing 

** 

1 

2 

-0.48 

0.00 


B 

0 

0 

0 

0.00 

0.00 

A 

C 

0 

3 

5 

2.05 

0.30 

<4 

A 

1 

54 

95 

2.20 

0.20 


Missing 

** 






A 

0 

0 

0 

0.00 

0.00 


B 

0 

1 

2 

-1.12 

0.00 


C 

1 

56 

98 

2.25 

0.18 


Missing 

** 






A 

0 

1 

2 

3.9 

0.00 


C 

0 

4 

7 

0.07 

0.56 

0 

B 

1 

52 

91 

2.32 

0.18 


Missing 

** 






B 

0 

3 

5 

1.75 

0.30 

7 

C 

0 

9 

16 

0.93 

0.43 

/ 

A 

1 

43 

75 

2.58 

0.19 


Missing 

** 

2 

4 

0.12 

0.30 


C 

0 

0 

0 

0.00 

0.00 

8 

A 

0 

1 

2 

-0.18 

0.00 

B 

1 

56 

98 

2.24 

0.18 


Missing 

** 






B 

0 

5 

9 

0.39 

0.34 

o 

A 

0 

11 

19 

1.60 

0.39 

y 

C 

1 

41 

72 

2.57 

0.20 


Missing 

** 






A 

0 

5 

9 

1.26 

0.60 

10 

B 

0 

5 

9 

1.14 

0.76 

C 

1 

46 

81 

2.47 

0.19 


Missing 

** 

1 

2 

-0.48 

0.00 



Table 16 


Distractor Analysis, Grade 5 MCRC Form 15 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


C 

0 

1 

2 

1.44 

0.00 

11 

A 

0 

6 

11 

1.15 

0.63 

B 

1 

49 

86 

2.39 

0.19 


Missing 

** 

1 

2 

-0.48 

0.00 


C 

0 

10 

18 

1.38 

0.36 

12 

A 

1 

22 

39 

3.12 

0.31 

B 

Missing 

0 

** 

25 

44 

1.70 

0.19 


C 

0 

2 

4 

-0.19 

0.93 

13 

A 

0 

19 

33 

1.41 

0.28 

B 

Missing 

1 

** 

36 

63 

2.74 

0.20 


B 

0 

2 

4 

0.13 

0.61 

14 

C 

0 

9 

16 

1.40 

0.27 

A 

Missing 

1 

** 

46 

81 

2.44 

0.21 


A 

0 

1 

2 

-0.48 

0.00 

15 

B 

0 

21 

37 

1.45 

0.27 

C 

Missing 

1 

** 

35 

61 

2.71 

0.21 


B 

0 

5 

9 

-0.19 

0.34 

16 

A 

1 

19 

33 

3.14 

0.32 

C 

Missing 

0 

** 

33 

58 

2.01 

0.16 


A 

0 

2 

4 

-0.35 

0.77 

17 

C 

0 

4 

7 

0.53 

0.40 

B 

Missing 

1 

** 

51 

89 

2.42 

0.18 


A 

0 

1 

2 

-1.12 

0.00 

18 

C 

0 

2 

4 

2.21 

0.77 

B 

1 

52 

91 

2.31 

0.19 


Missing 

** 

2 

4 

0.78 

0.66 


B 

0 

4 

7 

-0.57 

0.20 

19 

C 

0 

7 

12 

1.50 

0.25 

A 

1 

45 

79 

2.59 

0.18 


Missing 

** 

1 

2 

0.12 

0.00 


A 

0 

2 

4 

0.74 

0.00 

20 

B 

0 

5 

9 

-0.37 

0.25 

C 

1 

49 

86 

2.56 

0.16 


Missing 

** 

1 

2 

0.12 

0.00 
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Table 17 

Item Statistics, Entry Order, Grade 5 MCRC Form 16 


Item Number 

Raw 

Score 

Count 

Measure 

Model Standard 
Error 

mean square 
outfit 

1 

55 

56 

-3.50 

0.17 

0.63 

2 

49 

56 

-0.95 

0.04 

0.90 

3 

52 

56 

-1.77 

-0.79 

0.26 

4 

33 

56 

1.21 

-0.95 

0.77 

5 

48 

56 

-0.74 

-0.25 

0.77 

6 

47 

56 

-0.55 

-1.12 

0.47 

7 

50 

56 

-1.18 

0.39 

1.11 

8 

46 

56 

-0.38 

-1.03 

0.54 

9 

37 

56 

0.79 

-1.06 

0.73 

10 

48 

56 

-0.74 

-0.53 

0.64 

11 

50 

56 

-1.18 

0.79 

1.45 

12 

37 

56 

0.79 

-0.33 

0.90 

13 

21 

56 

2.35 

0.85 

1.27 

14 

46 

56 

-0.38 

0.57 

1.21 

15 

46 

56 

-0.38 

-0.86 

0.59 

16 

32 

56 

1.30 

0.54 

1.11 

17 

40 

56 

0.45 

-0.41 

0.85 

18 

22 

56 

2.25 

1.85 

1.66 

19 

35 

56 

1.00 

1.22 

1.31 

20 

29 

56 

1.59 

-0.23 

0.93 



Table 18 


Distractor Analysis, Grade 5 MCRC Form 16 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


t 

0 

0 

0 

0.00 

0.00 

1 

C 

0 

1 

2 

0.02 

0.00 

B 

1 

55 

98 

1.63 

0.18 


Missing 

** 






A 

0 

3 

5 

-0.37 

1.38 


C 

0 

4 

7 

0.23 

0.29 

L 

B 

1 

49 

88 

1.83 

0.17 


Missing 

** 






B 

0 

2 

4 

-0.39 

0.14 

'l 

C 

0 

2 

4 

-1.71 

0.58 


A 

1 

52 

93 

1.80 

0.16 


Missing 

** 






C 

0 

2 

4 

-0.12 

0.42 

A 

B 

0 

21 

38 

0.72 

0.31 

<4 

A 

1 

33 

59 

2.26 

0.15 


Missing 

** 






C 

0 

3 

5 

-0.93 

0.70 


A 

0 

4 

7 

1.12 

0.29 


B 

1 

48 

86 

1.85 

0.17 


Missing 

** 

1 

2 

-1.13 

0.00 


B 

0 

2 

4 

0.32 

0.85 


A 

0 

7 

13 

-0.63 

0.52 

0 

C 

1 

47 

84 

1.98 

0.14 


Missing 

** 






A 

0 

3 

5 

-0.45 

0.41 

n 

C 

0 

3 

5 

0.51 

1.42 

/ 

B 

1 

50 

89 

1.79 

0.17 


Missing 

** 






C 

0 

2 

4 

-0.56 

1.73 

8 

B 

0 

8 

14 

-0.08 

0.40 

A 

1 

46 

82 

1.98 

0.15 


Missing 

** 






B 

0 

3 

5 

-0.07 

0.24 

o 

A 

0 

16 

29 

0.52 

0.37 

y 

C 

1 

37 

66 

2.20 

0.15 


Missing 

** 






C 

0 

3 

5 

-0.85 

0.92 

10 

B 

0 

5 

9 

0.26 

0.68 

A 

1 

48 

86 

1.89 

0.16 


Missing 

** 







Table 18 


Distractor Analysis, Grade 5 MCRC Form 16 (Continued) 


Entry # 

Data Code 

Score Value 

Count 

% 

Average 

Measure 

S.E. Mean 


A 

0 

1 

2 

0.30 

0.00 

11 

B 

0 

3 

5 

1.73 

0.57 

C 

1 

50 

89 

1.77 

0.17 


Missing 

** 

2 

4 

-2.29 

0.00 


A 

0 

2 

4 

-0.27 

0.85 

12 

B 

0 

15 

27 

1.03 

0.30 

C 

1 

37 

66 

2.14 

0.15 


Missing 

** 

2 

4 

-2.29 

0.00 


A 

0 

2 

4 

1.16 

1.14 

13 

B 

1 

21 

38 

2.12 

0.22 

C 

0 

31 

55 

1.52 

0.21 


Missing 

** 

2 

4 

-2.29 

0.00 


B 

0 

0 

0 

0.00 

0.00 

14 

A 

0 

8 

14 

0.93 

0.46 

C 

1 

46 

82 

1.88 

0.16 


Missing 

** 

2 

4 

-2.29 

0.00 


A 

0 

2 

4 

0.45 

0.42 

15 

C 

0 

6 

11 

0.16 

0.48 

B 

1 

46 

82 

2.00 

0.14 


Missing 

** 

2 

4 

-2.29 

0.00 


B 

0 

5 

9 

0.78 

0.70 

16 

C 

0 

17 

30 

1.29 

0.26 

A 

1 

32 

57 

2.13 

0.17 


Missing 

** 

2 

4 

-2.29 

0.00 


A 

0 

4 

7 

1.23 

0.80 

17 

B 

0 

10 

18 

0.58 

0.23 

C 

1 

40 

71 

2.08 

0.16 


Missing 

** 

2 

4 

-2.29 

0.00 


C 

0 

15 

27 

1.50 

0.36 

18 

B 

0 

16 

29 

1.74 

0.18 

A 

1 

22 

39 

1.90 

0.27 


Missing 

** 

3 

5 

-0.9 

1.39 


A 

0 

9 

16 

1.45 

0.39 

19 

C 

0 

9 

16 

1.19 

0.32 

B 

1 

35 

63 

1.95 

0.20 


Missing 

** 

3 

5 

-0.9 

1.39 


C 

0 

8 

14 

1.36 

0.47 

20 

A 

0 

16 

29 

0.96 

0.18 

B 

1 

29 

52 

2.27 

0.20 


Missing 

** 

3 

5 

-0.90 

1.39 



